-- Logs begin at Tue 2022-10-11 11:20:06 UTC, end at Tue 2022-10-11 12:26:30 UTC. -- Oct 11 11:51:00.234452 dv-cinder-820994-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 11 11:51:00.243774 dv-cinder-820994-6-iscsi devstack@n-api.service[103750]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 11 11:51:00.246021 dv-cinder-820994-6-iscsi devstack@n-api.service[103750]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 11 11:51:00 2022] *** Oct 11 11:51:00.246021 dv-cinder-820994-6-iscsi devstack@n-api.service[103750]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 11 11:51:00.246021 dv-cinder-820994-6-iscsi devstack@n-api.service[103750]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 11 11:51:00.246021 dv-cinder-820994-6-iscsi devstack@n-api.service[103750]: nodename: dv-cinder-820994-6-iscsi Oct 11 11:51:00.246021 dv-cinder-820994-6-iscsi devstack@n-api.service[103750]: machine: x86_64 Oct 11 11:51:00.246021 dv-cinder-820994-6-iscsi devstack@n-api.service[103750]: clock source: unix Oct 11 11:51:00.246021 dv-cinder-820994-6-iscsi devstack@n-api.service[103750]: pcre jit disabled Oct 11 11:51:00.246021 dv-cinder-820994-6-iscsi devstack@n-api.service[103750]: detected number of CPU cores: 4 Oct 11 11:51:00.246021 dv-cinder-820994-6-iscsi devstack@n-api.service[103750]: current working directory: / Oct 11 11:51:00.246021 dv-cinder-820994-6-iscsi devstack@n-api.service[103750]: detected binary path: /usr/bin/uwsgi-core Oct 11 11:51:00.246766 dv-cinder-820994-6-iscsi devstack@n-api.service[103750]: your processes number limit is 47680 Oct 11 11:51:00.246766 dv-cinder-820994-6-iscsi devstack@n-api.service[103750]: your memory page size is 4096 bytes Oct 11 11:51:00.246766 dv-cinder-820994-6-iscsi devstack@n-api.service[103750]: detected max file descriptor number: 2048 Oct 11 11:51:00.246766 dv-cinder-820994-6-iscsi devstack@n-api.service[103750]: lock engine: pthread robust mutexes Oct 11 11:51:00.246766 dv-cinder-820994-6-iscsi devstack@n-api.service[103750]: thunder lock: enabled Oct 11 11:51:00.246766 dv-cinder-820994-6-iscsi devstack@n-api.service[103750]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 11 11:51:00.246766 dv-cinder-820994-6-iscsi devstack@n-api.service[103750]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 11 11:51:00.289055 dv-cinder-820994-6-iscsi devstack@n-api.service[103750]: Python main interpreter initialized at 0x55625eabd9c0 Oct 11 11:51:00.289055 dv-cinder-820994-6-iscsi devstack@n-api.service[103750]: python threads support enabled Oct 11 11:51:00.289055 dv-cinder-820994-6-iscsi devstack@n-api.service[103750]: your server socket listen backlog is limited to 100 connections Oct 11 11:51:00.289055 dv-cinder-820994-6-iscsi devstack@n-api.service[103750]: your mercy for graceful operations on workers is 90 seconds Oct 11 11:51:00.289558 dv-cinder-820994-6-iscsi devstack@n-api.service[103750]: mapped 403077 bytes (393 KB) for 2 cores Oct 11 11:51:00.289558 dv-cinder-820994-6-iscsi devstack@n-api.service[103750]: *** Operational MODE: preforking *** Oct 11 11:51:00.289802 dv-cinder-820994-6-iscsi devstack@n-api.service[103750]: *** uWSGI is running in multiple interpreter mode *** Oct 11 11:51:00.289802 dv-cinder-820994-6-iscsi devstack@n-api.service[103750]: spawned uWSGI master process (pid: 103750) Oct 11 11:51:00.290038 dv-cinder-820994-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 11 11:51:00.290590 dv-cinder-820994-6-iscsi devstack@n-api.service[103750]: spawned uWSGI worker 1 (pid: 103751, cores: 1) Oct 11 11:51:00.290926 dv-cinder-820994-6-iscsi devstack@n-api.service[103750]: spawned uWSGI worker 2 (pid: 103752, cores: 1) Oct 11 11:51:00.291088 dv-cinder-820994-6-iscsi devstack@n-api.service[103750]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 11 11:51:00.945258 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 11 11:51:00.947847 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 11 11:51:02.012679 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 11:51:02.012679 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: from cryptography.utils import int_from_bytes Oct 11 11:51:02.013327 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 11:51:02.013327 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: from cryptography.utils import int_from_bytes Oct 11 11:51:02.013717 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 11:51:02.013717 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: from cryptography.utils import int_from_bytes Oct 11 11:51:02.013857 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 11:51:02.013857 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: from cryptography.utils import int_from_bytes Oct 11 11:51:04.485693 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 11 11:51:04.486303 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 11 11:51:04.486303 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 11 11:51:04.486763 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 11 11:51:04.486835 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 11 11:51:04.486916 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 11 11:51:04.487001 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 11 11:51:04.487071 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 11 11:51:04.487143 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 11 11:51:04.487220 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 11 11:51:04.487411 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.487510 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.487734 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.487836 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.488072 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.488216 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.488359 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.488479 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.488710 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.488853 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.488986 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.489089 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.489323 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.489453 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.489605 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.489703 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.489938 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.490069 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.490154 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.490250 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.490487 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.490658 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.490838 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820994-6-iscsi {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.490988 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820994-6-iscsi {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.491157 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.491303 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.491457 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.491590 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.491713 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.491839 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.492045 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.492232 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.492474 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.492604 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.492725 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.492850 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.492981 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.493116 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.493467 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.493654 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.494748 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.494902 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.495017 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.495150 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.495150 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.495385 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.495506 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.495628 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.495757 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.495877 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.496009 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.496136 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.496266 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.496387 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.496515 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.496625 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.496756 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.496882 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.497008 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.497223 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.497223 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820994-6-iscsi {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.497442 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820994-6-iscsi {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.497569 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.497690 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.497821 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.497940 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.498064 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.498176 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.498307 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.498444 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.498591 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.498802 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.498952 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.499074 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.499199 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.499326 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.499437 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.499571 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.499721 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.499854 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.500069 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.500246 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.500376 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.500513 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.500637 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.500757 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.500978 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.501156 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.501296 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.501437 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.501559 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.501679 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.501836 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.501968 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.502170 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.502369 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.502510 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.502673 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.502808 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.502930 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.503064 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.503185 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.503303 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.503422 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.503565 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.503691 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.503907 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.504096 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.504229 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.504357 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.504480 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.504617 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.504740 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.504860 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.504980 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.505093 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.505297 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.505489 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.505623 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.505748 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.505869 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.505997 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.506130 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.506251 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.506448 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.506644 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.506776 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.506898 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.507038 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.507163 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.507290 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.507411 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.507626 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.507803 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.507948 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.508075 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.508275 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.508451 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.508581 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.508703 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.508854 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.509060 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.509195 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.509318 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.509543 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.509738 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.509738 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.509979 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.510107 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.510227 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.510349 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.510478 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.510663 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.510786 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.510986 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.511180 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.511313 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.511449 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.511573 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.511692 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.511882 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.512057 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.512188 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.512322 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.512448 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.512566 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.512772 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.512947 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.513091 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.513217 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.513337 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.513458 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.513585 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.513713 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.513848 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.513971 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.514167 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.514294 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.514481 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.514628 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.514796 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.514925 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.515105 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.515237 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.515413 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.515549 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.515679 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.515799 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.515981 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.516107 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.516277 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.516402 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.516578 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.516705 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.516838 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.516957 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.517158 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.517294 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.517421 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.517540 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.517732 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.517866 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.518036 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.518172 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.518322 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.518448 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.518624 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.518748 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.518960 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.519195 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.519322 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.519441 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.519560 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.519689 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.519935 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.520069 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.520214 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.520418 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.520542 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.520661 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.520790 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.520919 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.521040 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.521159 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.521284 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.521404 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.521591 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.521729 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.521883 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.522010 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.522193 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.522320 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.522502 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.522667 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.522800 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.522923 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.523116 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.523243 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.523430 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.523712 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.523837 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.523973 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.524155 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.524279 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.524413 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.524534 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.524653 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.524783 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.524935 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.525071 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.525231 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.525369 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.525541 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.525668 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.525837 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.525962 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.526096 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.526216 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.526413 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.526540 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.526739 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.526864 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.526997 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.527118 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.527318 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.527452 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.527629 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.527763 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.527922 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.528047 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.528228 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.528352 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.528522 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.528656 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.528835 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.528962 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:51:04.529542 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.529674 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.529852 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.529988 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.530186 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.530313 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.530489 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.530673 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.530854 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.530995 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.531129 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.531247 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.531464 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.531602 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.531736 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.531855 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.532060 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.532187 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.532376 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.532508 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.532668 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.532793 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.532980 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.533104 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.533283 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.533415 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.533600 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.533747 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.533878 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.533997 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.534212 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.534349 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.534511 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.534661 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.534858 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.534984 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.535168 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.535311 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.535442 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.535563 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.535767 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.535894 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.536084 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.536210 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.536402 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.536528 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.536706 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.536831 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.537037 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.537171 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.537376 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.537502 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.537678 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.537796 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.537994 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.538128 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.538311 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.538436 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.538635 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.538764 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.538944 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.539099 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.539265 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.539406 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.539646 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.539780 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.539916 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.540037 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.540193 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.540321 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.540512 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.540637 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.540825 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.540951 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.541125 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.541250 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.541431 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.541564 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.541726 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.541852 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.542037 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.542170 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.542328 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.542458 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.542743 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.542870 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.542991 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.543118 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.543254 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.543382 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.543577 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.543706 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.543886 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.544011 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.544189 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.544330 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.544489 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.544615 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.544800 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.544926 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.545102 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.545237 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.545395 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.545524 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.545699 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.545827 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.545960 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.546088 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.546271 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.546398 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.546572 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.546697 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.546887 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.547031 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.547202 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.547327 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.547516 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.547641 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.547825 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.547944 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.548142 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.548277 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.548429 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.548554 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.548742 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.548868 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.549046 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.549173 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.549347 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.549490 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.549619 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.549749 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.549945 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.550068 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.550202 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.550330 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.550519 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.550668 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.550849 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.550975 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.551150 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.551277 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.551415 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.551536 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.551751 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.551879 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.552049 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.552184 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.552337 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.552463 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.552650 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.552783 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.552962 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.553096 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.553226 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.553347 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.553562 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.553690 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.553810 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.553938 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.554153 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.554271 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.554433 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.554666 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.554910 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.555038 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.555169 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.555302 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.555425 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.555552 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.555723 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.555848 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.556041 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.556171 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.556356 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.556481 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.556664 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.556787 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.556960 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.557117 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.557263 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.557387 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.557561 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.557686 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.557858 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.558003 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.558182 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.558320 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.558442 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.558599 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.558749 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.558874 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.559041 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.559177 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.559329 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.559466 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.559624 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.559749 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.560000 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.560142 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.560266 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.560384 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.560505 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.560625 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.560795 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.560933 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.561089 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.561213 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.561381 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.561503 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.561713 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.561841 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.562008 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.562140 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.562346 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.562477 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.562697 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.562826 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.563009 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.563140 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.563322 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.563455 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.563625 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.563749 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.563932 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.564055 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.564233 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.564356 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.564536 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.564659 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.564838 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.564970 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.565140 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.565273 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.565451 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.565575 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.565751 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.565875 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.566060 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.566192 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.566359 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.566481 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.566698 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.566822 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.567002 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.567134 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.567312 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.567443 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.567608 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.567730 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.567916 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.568053 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.568247 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.568369 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.568568 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.568689 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.568877 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.569009 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.569190 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.569327 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.569490 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.569600 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.569794 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.569919 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.570130 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.570253 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.570418 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.570542 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.570773 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.570896 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.571054 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.571176 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.571333 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.571460 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.571635 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.571759 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.571945 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.572066 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.572246 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.572368 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.572559 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.572682 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.572859 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.572984 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.573169 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.573292 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.573457 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.573579 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.573758 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.573882 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.574076 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.574208 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.574398 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.574521 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.574723 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.574846 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.575025 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.575161 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.575340 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.575464 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.575641 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.575763 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.575942 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.576073 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.576243 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.576367 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.576541 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.576672 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.576836 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.576968 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.577137 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.577259 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.577441 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.577571 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.577743 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.577866 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.578043 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.578166 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.578338 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.578462 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.578667 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.578793 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.578970 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.579092 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.579266 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.579388 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.579563 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.579679 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.579865 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.579988 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.580265 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.580405 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.580540 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.580662 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.580781 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.580901 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.581086 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.581219 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.581384 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.581506 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.581681 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.581803 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.581997 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.582135 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.582305 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.582437 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.582628 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.582753 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.582920 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.583058 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.583219 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.583342 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.583554 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.583677 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.583857 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.584009 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.584237 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.584366 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.584486 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.584605 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.584735 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.584857 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.585051 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.585183 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.585352 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.585474 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.585656 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.585780 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.585985 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.586139 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.586328 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.586451 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.586658 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.586783 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.586962 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.587090 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.587264 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.587394 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.587566 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.587691 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.587870 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.587995 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.588173 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.588309 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.588488 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.588611 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.588791 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.588914 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.589094 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.589226 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.589397 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.589528 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.589691 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.589813 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.589994 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.590128 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.590385 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.590517 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.590907 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.591034 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.591235 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.591372 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.591545 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.591676 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.591855 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.591977 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.592201 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.592337 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.592507 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.592675 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.592830 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.592954 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.593152 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.593275 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.593456 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.593587 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.593756 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.593878 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.594059 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.594192 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.594361 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.594604 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.594729 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.594861 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.594983 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.595103 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.595263 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.595387 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.595561 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.595683 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.595856 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.595979 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.596155 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.596280 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.596449 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.596571 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.596743 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.596874 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.597040 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.597164 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.597335 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.597466 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.597641 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.597762 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.598039 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.598222 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.598222 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.598451 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.598598 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.598737 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.598869 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.598990 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.599121 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.599241 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.599423 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.599555 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.599717 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.599834 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.600013 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.600143 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.600345 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.600491 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.600685 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.600809 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.600962 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.601088 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.601280 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.601412 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.601724 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.601859 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.602034 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.602157 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.602331 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.602456 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.602670 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.602793 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.602968 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.603089 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.603265 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.603389 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.603562 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.603685 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.603862 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.603984 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.604161 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.604285 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.604456 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.604579 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.604758 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.604880 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.605055 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.605179 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.605355 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.605477 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.605655 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.605788 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.605950 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.606073 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.606250 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.606372 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.606546 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.606737 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.606861 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.606981 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.607162 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.607294 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.607457 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.607588 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.607751 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.607875 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.608052 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.608183 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.608351 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.608482 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.608645 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.608768 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.608949 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.609073 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.609242 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.609374 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.609549 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.609673 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.609845 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.609962 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.610158 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.610294 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.610437 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.610575 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.610785 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.610917 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.611057 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.611178 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.611342 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.611465 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.611656 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.611778 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.611958 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.612082 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.612251 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.612387 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.612539 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.612672 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.612833 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.612957 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.613127 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.613249 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.613403 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.613557 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.613708 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.613832 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.614019 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.614150 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.614334 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.614465 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.614645 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.614769 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.614942 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.615068 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.615236 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.615368 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.615532 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.615655 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.615826 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.615948 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.616126 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.616251 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.616424 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.616546 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.616703 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.616839 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.616998 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.617134 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.617319 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.617443 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.617615 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.617738 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.617930 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.618053 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.618230 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.618362 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.618524 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.618666 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.618845 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.618968 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.619205 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.619327 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.619540 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.619673 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.619918 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.620041 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.620186 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.620311 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.620487 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.620620 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.620796 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.621002 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.621127 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.621246 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.621394 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.621530 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.621698 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.621827 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.622001 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.622124 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.622298 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.622501 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.622664 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.622783 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.622903 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.623035 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.623208 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.623342 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.623506 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.623629 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.623801 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.623923 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.624113 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.624312 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.624436 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.624556 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.624711 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.624847 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.625023 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.625147 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.625335 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.625457 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.625651 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.625774 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.625945 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.626069 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.626251 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.626380 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.626569 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.626694 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.626878 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.627004 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.627180 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.627302 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.627480 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.627611 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.627780 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.627910 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.628083 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.628206 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.628386 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.628516 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.628689 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.628818 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.628988 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.629116 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.629285 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.629416 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.629584 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.629705 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.629882 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.630005 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.630176 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.630306 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.630492 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.630658 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.630816 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.630927 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.631140 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.631264 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.631383 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.631510 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.631681 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.631805 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.631979 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.632102 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.632271 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.632393 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.632706 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.632856 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.633079 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.633202 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.633386 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.633516 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.633685 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.633810 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.633990 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.634115 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.634292 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.634414 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.634621 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.634761 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.634931 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.635054 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.635228 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.635349 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.635632 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.635774 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.635936 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.636058 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.636240 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.636363 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.636542 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.636673 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.636837 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.636968 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.637132 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.637263 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.637432 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.637562 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.637745 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.637867 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.638040 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.638167 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.638340 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.638464 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.638658 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.638783 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.638972 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.639127 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.639263 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.639385 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.639566 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.639700 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.639969 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.640093 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.640274 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.640399 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.640572 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.640696 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.640975 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.641114 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.641312 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.641438 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.641558 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.641850 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.641991 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.642113 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.642225 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.642328 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.642474 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.642609 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.642796 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.642918 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.643102 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.643235 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.643404 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.643532 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.643718 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.643850 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.644031 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.644167 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.644332 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.644455 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.644637 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.644760 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.644931 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.645062 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.645245 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.645370 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.645559 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.645692 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.645865 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.646002 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.646185 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.646307 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.646607 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.646735 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.646926 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.647051 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.647228 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.647352 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.647545 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.647681 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.647863 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.647987 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.648160 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.648292 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.648483 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.648610 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.648792 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.648917 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.649089 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.649212 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.649386 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.649509 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.649698 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.649823 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.649995 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.650118 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.650295 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.650514 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.650654 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.650774 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.650899 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.651017 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.651195 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.651348 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.651515 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.651637 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.651803 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.651992 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.652116 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.652243 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.652390 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.652514 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.652690 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.652812 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.653002 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.653138 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.653312 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.653435 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.653644 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.653770 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.653901 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.654022 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.654576 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.654715 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.654879 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.655005 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.655177 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.655303 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.655472 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.655604 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.655807 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.655932 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.656104 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.656235 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.656416 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.656539 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.656737 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.656859 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.657058 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.657191 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.657361 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.657484 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.657682 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.657814 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.657999 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.658121 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.658311 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.658435 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.658633 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.658771 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.658948 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.659073 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.659263 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.659386 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.659559 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.659692 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.659853 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.659975 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.660151 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.660275 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.660445 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.660571 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.660741 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.660864 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.661033 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.661143 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.661331 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.661443 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.661621 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.661743 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.661914 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.662112 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.662246 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.662368 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.662488 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.662665 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.662822 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.662947 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.663142 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.663267 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.663432 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.663554 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.663727 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.663864 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.664021 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.664203 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.664380 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.664504 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.664713 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.664846 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.665011 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.665134 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.665331 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.665461 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.665631 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.665764 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.665944 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.666067 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.666252 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.666375 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.666579 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.666718 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.666885 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.667017 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.667191 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.667313 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.667498 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.667623 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.667845 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.667975 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.668097 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.668224 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.668421 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.668552 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.668675 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.668795 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.668973 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.669098 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.669446 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.669584 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.669837 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.670019 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.670214 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.670338 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.670475 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.670611 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.670749 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.670880 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.671055 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.671192 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.671358 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.671475 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.671661 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.671786 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.671962 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.672110 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.672311 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.672435 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.672557 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.672678 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.672839 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.672975 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.673158 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.673287 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.673500 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.673627 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.673785 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.673911 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.674111 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.674243 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.674423 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.674548 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.674751 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.674880 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.675050 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.675175 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.675353 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.675483 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.675688 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.675815 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.675994 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.676120 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.676292 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.676424 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.676599 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.676722 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.676904 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.677028 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.677209 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.677341 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.677511 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.677635 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.677812 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.677935 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.678153 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.678286 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.678408 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.678526 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.678736 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.678862 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.679038 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.679165 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.679344 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.679479 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.679647 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.679802 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.680013 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.680140 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.680337 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.680461 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.680650 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.680781 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.680955 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.681084 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.681259 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.681390 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.681564 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.681697 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.682073 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.682198 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.682406 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.682537 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.682729 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.682863 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.683051 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.683174 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.683368 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.683493 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.683683 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.683806 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.683994 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.684124 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.684371 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.684503 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.684638 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.684759 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.684901 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.685026 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.685203 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.685325 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.685505 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.685631 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.685801 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.685923 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.686114 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.686236 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.686418 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.686542 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.686725 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.686829 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.687042 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.687180 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.687343 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.687466 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.687863 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.687988 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.688204 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.688336 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.688514 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.688638 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.688830 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.688960 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.689146 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.689286 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.689454 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.689578 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.689753 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.689875 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.690067 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.690199 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.690364 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.690488 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.690684 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.690801 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.690993 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.691117 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.691300 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.691422 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.691641 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.691782 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.691913 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.692034 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.692183 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.692309 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.692517 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.692648 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.692780 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.692901 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.693061 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.693186 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.693356 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.693479 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.693673 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.693798 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.693969 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.694087 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.694266 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.694399 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.694620 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.694750 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.694885 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.695006 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.695181 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.695344 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.695533 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.695657 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.695833 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.695957 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.696129 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.696262 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.696432 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.696555 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.696726 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.696849 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.697027 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.697158 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.697322 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.697444 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.697623 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.697746 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.697971 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.698105 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.698275 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.698401 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.698593 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.698720 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.698921 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.699049 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.699213 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.699338 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.699510 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.699628 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.699822 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.699948 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.700126 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.700250 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.700440 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.700563 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.700744 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.700871 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.701052 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.701184 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.701393 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.701530 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.701701 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.701825 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.702260 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.702393 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.702635 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.702775 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.703072 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.703198 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.703320 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.703440 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.703560 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.703691 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.703945 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.704076 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.704188 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.704309 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.704429 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.704628 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.704753 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.704873 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.704994 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.705115 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.705300 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.705436 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.705601 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.705734 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.705904 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.706027 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.706187 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.706311 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.706493 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.706694 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.706829 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.706973 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.707136 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.707260 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.707390 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.707513 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.707680 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.707819 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.707981 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.708104 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.708283 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.708416 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.708583 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.708720 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.708883 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.709008 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.709186 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.709310 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.709520 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.709654 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.709833 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.709973 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.710141 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.710264 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.710446 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.710594 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.710781 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.710904 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.711137 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.711241 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.711409 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.711621 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.711746 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.711933 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.712059 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.712238 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.712372 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.712549 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.712724 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.712956 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.713083 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.713214 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.713337 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.713521 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.713886 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.714153 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.714354 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.714638 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.714837 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.714837 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.715112 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.715248 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.715371 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.715507 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.715630 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.715751 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.715874 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.716060 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.716186 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.716378 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.716510 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.716682 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.716805 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.716984 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.717194 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.717387 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.717581 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.717771 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.717963 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.718156 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.718355 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.718496 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.718737 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.718918 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.719113 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.719299 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.719502 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.719692 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.719974 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.719974 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.720354 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.720552 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.720746 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.720932 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.720932 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.721319 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.721521 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.721521 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.721918 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.722116 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.722116 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.722500 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.722795 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.722795 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.723332 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.723511 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.723649 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.723757 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.723757 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.725176 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.725369 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.725369 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.725738 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.725938 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.726152 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.726356 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.726549 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.726800 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.726800 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.727157 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.727294 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.727431 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.727581 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.727781 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.727983 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.728122 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.728255 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.728379 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.728379 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.728618 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.728618 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.728855 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.728985 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.729115 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.729115 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.729360 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.729490 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.729621 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.729744 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.729863 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.729983 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.730109 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.730229 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.730358 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.730479 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.730658 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.730783 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.730904 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.731033 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.731171 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.731293 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.731404 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.731523 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.731644 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.731782 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.731904 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.732031 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.732152 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.732272 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.732392 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.732525 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.732659 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.732790 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.732912 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.733032 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.733143 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.733288 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.733482 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.733607 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.733729 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.733849 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.733969 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.734100 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.734222 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.734342 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.734463 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.734610 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.734822 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.734947 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.735053 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.735173 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.735298 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.735429 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.735559 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.735690 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.735860 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.735860 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.736105 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.736227 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.736360 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.736482 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.736602 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.736722 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.736851 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.736982 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.737119 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.737250 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.737380 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.737502 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.737622 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.737838 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.737969 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.738141 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.738268 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.738449 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.738598 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.738793 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.738926 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.739101 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.739229 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.739407 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.739543 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.739721 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.739848 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.740032 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.740160 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.740366 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.740502 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.740673 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.740799 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.740978 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.741106 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.741276 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.741412 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.741526 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103752) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 11 11:51:04.741646 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.741936 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.742272 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.742640 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.742968 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.743279 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.743591 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.743890 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:51:04.744130 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103751) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 11 11:51:04.897697 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO dbcounter [None req-4fbdd178-e0d0-46b3-9807-9eb6479430af None None] Registered counter for database nova_api Oct 11 11:51:04.900527 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO dbcounter [None req-48f02b4e-c9f6-40cd-9e1d-4b1410f662fc None None] Registered counter for database nova_api Oct 11 11:51:04.921084 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG oslo_db.sqlalchemy.engines [None req-4fbdd178-e0d0-46b3-9807-9eb6479430af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103752) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 11:51:04.924351 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG oslo_db.sqlalchemy.engines [None req-48f02b4e-c9f6-40cd-9e1d-4b1410f662fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103751) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 11:51:04.928260 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG dbcounter [-] [103752] Writer thread running {{(pid=103752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 11:51:04.931369 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG dbcounter [-] [103751] Writer thread running {{(pid=103751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 11:51:04.987216 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.context [None req-4fbdd178-e0d0-46b3-9807-9eb6479430af None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e492fd93-7bd3-42bb-9bb9-d80ad3eb5733(cell1) {{(pid=103752) load_cells /opt/stack/nova/nova/context.py:464}} Oct 11 11:51:04.987479 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.context [None req-48f02b4e-c9f6-40cd-9e1d-4b1410f662fc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e492fd93-7bd3-42bb-9bb9-d80ad3eb5733(cell1) {{(pid=103751) load_cells /opt/stack/nova/nova/context.py:464}} Oct 11 11:51:04.990363 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG oslo_concurrency.lockutils [None req-4fbdd178-e0d0-46b3-9807-9eb6479430af None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 11:51:04.990877 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG oslo_concurrency.lockutils [None req-4fbdd178-e0d0-46b3-9807-9eb6479430af None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 11:51:04.991180 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG oslo_concurrency.lockutils [None req-48f02b4e-c9f6-40cd-9e1d-4b1410f662fc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 11:51:04.991652 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG oslo_concurrency.lockutils [None req-48f02b4e-c9f6-40cd-9e1d-4b1410f662fc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 11:51:04.992549 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG oslo_concurrency.lockutils [None req-4fbdd178-e0d0-46b3-9807-9eb6479430af None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 11:51:04.993301 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG oslo_concurrency.lockutils [None req-4fbdd178-e0d0-46b3-9807-9eb6479430af None None] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 11:51:04.993441 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG oslo_concurrency.lockutils [None req-48f02b4e-c9f6-40cd-9e1d-4b1410f662fc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 11:51:04.993748 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG oslo_concurrency.lockutils [None req-4fbdd178-e0d0-46b3-9807-9eb6479430af None None] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 11:51:04.994024 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG oslo_concurrency.lockutils [None req-48f02b4e-c9f6-40cd-9e1d-4b1410f662fc None None] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 11:51:04.994460 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG oslo_concurrency.lockutils [None req-48f02b4e-c9f6-40cd-9e1d-4b1410f662fc None None] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 11:51:04.995791 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG oslo_concurrency.lockutils [None req-4fbdd178-e0d0-46b3-9807-9eb6479430af None None] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103752) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 11:51:04.996452 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG oslo_concurrency.lockutils [None req-48f02b4e-c9f6-40cd-9e1d-4b1410f662fc None None] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 11:51:04.997842 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO dbcounter [None req-4fbdd178-e0d0-46b3-9807-9eb6479430af None None] Registered counter for database nova_cell0 Oct 11 11:51:04.998477 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO dbcounter [None req-48f02b4e-c9f6-40cd-9e1d-4b1410f662fc None None] Registered counter for database nova_cell0 Oct 11 11:51:05.002224 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO dbcounter [None req-4fbdd178-e0d0-46b3-9807-9eb6479430af None None] Registered counter for database nova_cell1 Oct 11 11:51:05.002527 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO dbcounter [None req-48f02b4e-c9f6-40cd-9e1d-4b1410f662fc None None] Registered counter for database nova_cell1 Oct 11 11:51:05.010222 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG oslo_db.sqlalchemy.engines [None req-48f02b4e-c9f6-40cd-9e1d-4b1410f662fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103751) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 11:51:05.011859 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG oslo_db.sqlalchemy.engines [None req-4fbdd178-e0d0-46b3-9807-9eb6479430af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103752) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 11:51:05.015138 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG oslo_db.sqlalchemy.engines [None req-48f02b4e-c9f6-40cd-9e1d-4b1410f662fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103751) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 11:51:05.016852 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG dbcounter [-] [103752] Writer thread running {{(pid=103752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 11:51:05.017532 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG oslo_db.sqlalchemy.engines [None req-4fbdd178-e0d0-46b3-9807-9eb6479430af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103752) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 11:51:05.018661 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG dbcounter [-] [103751] Writer thread running {{(pid=103751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 11:51:05.024450 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG dbcounter [-] [103751] Writer thread running {{(pid=103751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 11:51:05.159165 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG dbcounter [-] [103752] Writer thread running {{(pid=103752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 11:51:05.165513 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO dbcounter [None req-48f02b4e-c9f6-40cd-9e1d-4b1410f662fc None None] Registered counter for database nova_cell0 Oct 11 11:51:05.170036 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO dbcounter [None req-4fbdd178-e0d0-46b3-9807-9eb6479430af None None] Registered counter for database nova_cell0 Oct 11 11:51:05.176195 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG oslo_db.sqlalchemy.engines [None req-48f02b4e-c9f6-40cd-9e1d-4b1410f662fc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103751) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 11:51:05.178424 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG oslo_db.sqlalchemy.engines [None req-4fbdd178-e0d0-46b3-9807-9eb6479430af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103752) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 11:51:05.182738 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG dbcounter [-] [103751] Writer thread running {{(pid=103751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 11:51:05.183953 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG dbcounter [-] [103752] Writer thread running {{(pid=103752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 11:51:05.517333 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: WARNING keystonemiddleware.auth_token [None req-48f02b4e-c9f6-40cd-9e1d-4b1410f662fc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 11:51:05.524751 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: WARNING keystonemiddleware.auth_token [None req-48f02b4e-c9f6-40cd-9e1d-4b1410f662fc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 11:51:05.524883 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: WARNING keystonemiddleware.auth_token [None req-4fbdd178-e0d0-46b3-9807-9eb6479430af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 11:51:05.532517 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: WARNING keystonemiddleware.auth_token [None req-4fbdd178-e0d0-46b3-9807-9eb6479430af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 11:51:05.864735 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: WARNING keystonemiddleware.auth_token [None req-48f02b4e-c9f6-40cd-9e1d-4b1410f662fc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 11:51:05.870974 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: WARNING keystonemiddleware.auth_token [None req-48f02b4e-c9f6-40cd-9e1d-4b1410f662fc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 11:51:05.876505 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55625eabd9c0 pid: 103751 (default app) Oct 11 11:51:05.877169 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: WARNING keystonemiddleware.auth_token [None req-4fbdd178-e0d0-46b3-9807-9eb6479430af None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 11:51:05.878599 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-48f02b4e-c9f6-40cd-9e1d-4b1410f662fc None None] Calling method '>' {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:51:05.879795 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-48f02b4e-c9f6-40cd-9e1d-4b1410f662fc None None] 10.222.0.59 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001747 Oct 11 11:51:05.880195 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 788 bytes} [Tue Oct 11 11:51:05 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 11:51:05.883311 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: WARNING keystonemiddleware.auth_token [None req-4fbdd178-e0d0-46b3-9807-9eb6479430af None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 11:51:05.888805 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55625eabd9c0 pid: 103752 (default app) Oct 11 11:52:33.485139 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-48f02b4e-c9f6-40cd-9e1d-4b1410f662fc None None] Calling method '>' {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:52:33.486044 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-48f02b4e-c9f6-40cd-9e1d-4b1410f662fc None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Oct 11 11:52:33.486436 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 2/2] 10.222.0.59 () {54 vars in 931 bytes} [Tue Oct 11 11:52:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 11:52:33.499955 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG dbcounter [-] [103752] Writing DB stats nova_api:SELECT=3 {{(pid=103752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:33.501704 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG dbcounter [-] [103752] Writing DB stats nova_cell1:SELECT=3 {{(pid=103752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:33.502817 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG dbcounter [-] [103752] Writing DB stats nova_cell0:SELECT=3 {{(pid=103752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:33.505202 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG dbcounter [-] [103752] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:34.666043 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-921d8484-d943-4e1e-a4ee-846c872eed72 admin admin] Calling method '>' {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:52:34.705310 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-921d8484-d943-4e1e-a4ee-846c872eed72 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.211054 Oct 11 11:52:34.706008 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 1/3] 10.222.0.59 () {60 vars in 1292 bytes} [Tue Oct 11 11:52:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 11:52:37.609514 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-48f02b4e-c9f6-40cd-9e1d-4b1410f662fc None None] Calling method '>' {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:52:37.610802 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-48f02b4e-c9f6-40cd-9e1d-4b1410f662fc None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001892 Oct 11 11:52:37.611402 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 3/4] 10.222.0.59 () {54 vars in 931 bytes} [Tue Oct 11 11:52:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 11:52:38.235986 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-08d0ed85-a425-4977-b571-c140161ec30a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "c1", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1, "swap": 0, "name": "cirros256"}} {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 11:52:38.287263 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-08d0ed85-a425-4977-b571-c140161ec30a admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.665671 Oct 11 11:52:38.288224 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 2/5] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Oct 11 11:52:37 2022] POST /compute/v2.1/flavors => generated 407 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 11:52:38.301813 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG dbcounter [-] [103751] Writing DB stats nova_api:SELECT=3 {{(pid=103751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:38.302770 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG dbcounter [-] [103751] Writing DB stats nova_cell0:SELECT=3 {{(pid=103751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:38.305462 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG dbcounter [-] [103751] Writing DB stats nova_cell1:SELECT=3 {{(pid=103751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:38.306272 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG dbcounter [-] [103751] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:52:38.512279 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-51f9b548-7a23-4a49-af92-a2a6799f7dcd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 11:52:38.600504 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-51f9b548-7a23-4a49-af92-a2a6799f7dcd admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.303954 Oct 11 11:52:38.601097 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 4/6] 10.222.0.59 () {64 vars in 1336 bytes} [Tue Oct 11 11:52:38 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 11:52:41.325120 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-08d0ed85-a425-4977-b571-c140161ec30a admin admin] Calling method '>' {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:52:41.326945 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-08d0ed85-a425-4977-b571-c140161ec30a admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002251 Oct 11 11:52:41.327766 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 3/7] 10.222.0.59 () {54 vars in 931 bytes} [Tue Oct 11 11:52:41 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 11:52:42.215224 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-5cb9eb4c-400d-4beb-b5a5-07ecfb693312 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 5, "name": "ds512M", "ram": 512, "id": "d1", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 11:52:42.279115 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-5cb9eb4c-400d-4beb-b5a5-07ecfb693312 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.941131 Oct 11 11:52:42.280760 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 5/8] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Oct 11 11:52:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 11:52:42.293497 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-e8f12761-be8f-4525-b9fb-7efe4999443c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 11:52:42.347098 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-e8f12761-be8f-4525-b9fb-7efe4999443c admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.054743 Oct 11 11:52:42.347098 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 4/9] 10.222.0.59 () {64 vars in 1336 bytes} [Tue Oct 11 11:52:42 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 11:52:45.245247 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-5cb9eb4c-400d-4beb-b5a5-07ecfb693312 admin admin] Calling method '>' {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:52:45.246301 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-5cb9eb4c-400d-4beb-b5a5-07ecfb693312 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Oct 11 11:52:45.246746 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 6/10] 10.222.0.59 () {54 vars in 931 bytes} [Tue Oct 11 11:52:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 11:52:45.814860 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-1f56a623-df57-46de-b498-8d222296c19e admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "swap": 0, "id": "d2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "disk": 10, "name": "ds1G", "os-flavor-access:is_public": true}} {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 11:52:45.835330 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-1f56a623-df57-46de-b498-8d222296c19e admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.581701 Oct 11 11:52:45.835846 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 5/11] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Oct 11 11:52:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 11:52:45.849245 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-073e7c4a-d4f1-4903-902a-f798e119d8f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 11:52:45.880959 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-073e7c4a-d4f1-4903-902a-f798e119d8f2 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036236 Oct 11 11:52:45.881600 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 7/12] 10.222.0.59 () {64 vars in 1336 bytes} [Tue Oct 11 11:52:45 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 11:52:48.637403 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-1f56a623-df57-46de-b498-8d222296c19e admin admin] Calling method '>' {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:52:48.638667 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-1f56a623-df57-46de-b498-8d222296c19e admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001743 Oct 11 11:52:48.639477 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 6/13] 10.222.0.59 () {54 vars in 931 bytes} [Tue Oct 11 11:52:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 11:52:49.171384 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-8cdc2d8c-dd3c-4d7e-a426-c2ac8395cd70 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 10, "swap": 0, "os-flavor-access:is_public": true, "id": "d3", "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048}} {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 11:52:49.193450 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-8cdc2d8c-dd3c-4d7e-a426-c2ac8395cd70 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.547715 Oct 11 11:52:49.194015 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 8/14] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Oct 11 11:52:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 11:52:49.206664 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-ea2a0ca7-4fb1-4612-a3bb-e3981a3b8817 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 11:52:49.238658 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-ea2a0ca7-4fb1-4612-a3bb-e3981a3b8817 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035931 Oct 11 11:52:49.240083 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 7/15] 10.222.0.59 () {64 vars in 1336 bytes} [Tue Oct 11 11:52:49 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 11:52:52.091467 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-8cdc2d8c-dd3c-4d7e-a426-c2ac8395cd70 admin admin] Calling method '>' {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:52:52.092563 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-8cdc2d8c-dd3c-4d7e-a426-c2ac8395cd70 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001701 Oct 11 11:52:52.093233 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 9/16] 10.222.0.59 () {54 vars in 931 bytes} [Tue Oct 11 11:52:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 11:52:52.692109 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-c8ab2ff5-42b9-4794-a453-db387d756b2d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 4096, "name": "ds4G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d4", "vcpus": 4, "disk": 20}} {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 11:52:52.715905 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-c8ab2ff5-42b9-4794-a453-db387d756b2d admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.614202 Oct 11 11:52:52.716765 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 8/17] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Oct 11 11:52:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 11:52:52.731409 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-785ca1d4-5d1c-46a3-8801-598fbab71c22 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 11:52:52.764252 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-785ca1d4-5d1c-46a3-8801-598fbab71c22 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037733 Oct 11 11:52:52.764889 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 10/18] 10.222.0.59 () {64 vars in 1336 bytes} [Tue Oct 11 11:52:52 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 11:52:55.536728 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-c8ab2ff5-42b9-4794-a453-db387d756b2d admin admin] Calling method '>' {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:52:55.537746 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-c8ab2ff5-42b9-4794-a453-db387d756b2d admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001909 Oct 11 11:52:55.538169 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 9/19] 10.222.0.59 () {54 vars in 931 bytes} [Tue Oct 11 11:52:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 11:52:56.016045 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-61655af1-0600-459c-accf-5aff64f058c5 admin admin] Calling method '>' {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:52:56.042862 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-61655af1-0600-459c-accf-5aff64f058c5 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.495798 Oct 11 11:52:56.043409 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 11/20] 10.222.0.59 () {60 vars in 1292 bytes} [Tue Oct 11 11:52:55 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 11:52:58.776503 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-c8ab2ff5-42b9-4794-a453-db387d756b2d admin admin] Calling method '>' {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:52:58.777559 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-c8ab2ff5-42b9-4794-a453-db387d756b2d admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001961 Oct 11 11:52:58.777992 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 10/21] 10.222.0.59 () {54 vars in 931 bytes} [Tue Oct 11 11:52:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 11:52:59.249113 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-41886af0-9d9d-4854-90e2-17888b33be5e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "os-flavor-access:is_public": true, "name": "m1.tiny", "swap": 0, "disk": 1, "vcpus": 1}} {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 11:52:59.270353 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-41886af0-9d9d-4854-90e2-17888b33be5e admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.484665 Oct 11 11:52:59.271015 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 12/22] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Oct 11 11:52:58 2022] POST /compute/v2.1/flavors => generated 402 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 11:52:59.284631 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-b5833e7f-4ff5-490e-8334-03d4801985ea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 11:52:59.311638 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-b5833e7f-4ff5-490e-8334-03d4801985ea admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031154 Oct 11 11:52:59.312250 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 11/23] 10.222.0.59 () {64 vars in 1333 bytes} [Tue Oct 11 11:52:59 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 11:53:02.168944 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-41886af0-9d9d-4854-90e2-17888b33be5e admin admin] Calling method '>' {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:53:02.170042 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-41886af0-9d9d-4854-90e2-17888b33be5e admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001592 Oct 11 11:53:02.170480 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 13/24] 10.222.0.59 () {54 vars in 931 bytes} [Tue Oct 11 11:53:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 11:53:02.665134 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-0b07cfed-186d-4649-aff7-e1fd1169effa admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "id": "2", "os-flavor-access:is_public": true, "disk": 20, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 11:53:02.685046 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-0b07cfed-186d-4649-aff7-e1fd1169effa admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.506417 Oct 11 11:53:02.685914 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 12/25] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Oct 11 11:53:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 11:53:02.703084 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-e6df786f-6f1c-48d6-aac5-2613da94ef20 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 11:53:02.729741 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-e6df786f-6f1c-48d6-aac5-2613da94ef20 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031451 Oct 11 11:53:02.730341 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 14/26] 10.222.0.59 () {64 vars in 1333 bytes} [Tue Oct 11 11:53:02 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 11:53:05.457976 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-0b07cfed-186d-4649-aff7-e1fd1169effa admin admin] Calling method '>' {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:53:05.458969 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-0b07cfed-186d-4649-aff7-e1fd1169effa admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Oct 11 11:53:05.459372 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 13/27] 10.222.0.59 () {54 vars in 931 bytes} [Tue Oct 11 11:53:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 11:53:06.066830 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-28457e39-2149-4810-90cd-0d8153e6f362 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.medium", "disk": 40, "os-flavor-access:is_public": true, "vcpus": 2, "id": "3"}} {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 11:53:06.091328 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-28457e39-2149-4810-90cd-0d8153e6f362 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.625233 Oct 11 11:53:06.092299 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 15/28] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Oct 11 11:53:05 2022] POST /compute/v2.1/flavors => generated 406 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 11:53:06.104325 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-131b013e-2fb0-47ad-9b0b-9bc4ea0ece8d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 11:53:06.109367 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG dbcounter [-] [103752] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=103752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:06.139237 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-131b013e-2fb0-47ad-9b0b-9bc4ea0ece8d admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038637 Oct 11 11:53:06.140175 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 14/29] 10.222.0.59 () {64 vars in 1333 bytes} [Tue Oct 11 11:53:06 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 11:53:08.827107 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-28457e39-2149-4810-90cd-0d8153e6f362 admin admin] Calling method '>' {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:53:08.828098 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-28457e39-2149-4810-90cd-0d8153e6f362 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Oct 11 11:53:08.828686 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 16/30] 10.222.0.59 () {54 vars in 931 bytes} [Tue Oct 11 11:53:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 11:53:09.412217 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-9a8ffc3c-c9a1-4830-a811-e205774f2edb admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "os-flavor-access:is_public": true, "ram": 8192, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "name": "m1.large", "vcpus": 4}} {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 11:53:09.441203 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-9a8ffc3c-c9a1-4830-a811-e205774f2edb admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.601412 Oct 11 11:53:09.442388 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 15/31] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Oct 11 11:53:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 11:53:09.459883 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-fac9fcb2-0d0d-461a-9eb4-eeaa8e455390 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 11:53:09.466825 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG dbcounter [-] [103751] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=103751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:09.492251 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-fac9fcb2-0d0d-461a-9eb4-eeaa8e455390 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036464 Oct 11 11:53:09.494621 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 17/32] 10.222.0.59 () {64 vars in 1333 bytes} [Tue Oct 11 11:53:09 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 11:53:12.464838 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-9a8ffc3c-c9a1-4830-a811-e205774f2edb admin admin] Calling method '>' {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:53:12.468378 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-9a8ffc3c-c9a1-4830-a811-e205774f2edb admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002753 Oct 11 11:53:12.468378 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 16/33] 10.222.0.59 () {54 vars in 931 bytes} [Tue Oct 11 11:53:12 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 11:53:13.096502 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-07e7ea5a-0d1c-4a9d-8603-3e84c97393c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "5", "rxtx_factor": 1.0, "name": "m1.xlarge", "disk": 160, "ram": 16384, "os-flavor-access:is_public": true, "vcpus": 8}} {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 11:53:13.127638 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-07e7ea5a-0d1c-4a9d-8603-3e84c97393c8 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.651720 Oct 11 11:53:13.128767 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 18/34] 10.222.0.59 () {64 vars in 1283 bytes} [Tue Oct 11 11:53:12 2022] POST /compute/v2.1/flavors => generated 408 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 11:53:13.152233 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-20f718a8-6dd8-4e1d-9f66-e0f59561ff6d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 11:53:13.194030 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-20f718a8-6dd8-4e1d-9f66-e0f59561ff6d admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049668 Oct 11 11:53:13.210589 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 17/35] 10.222.0.59 () {64 vars in 1333 bytes} [Tue Oct 11 11:53:13 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 11:53:30.171641 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-07e7ea5a-0d1c-4a9d-8603-3e84c97393c8 admin admin] Calling method '>' {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:53:30.172719 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-07e7ea5a-0d1c-4a9d-8603-3e84c97393c8 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Oct 11 11:53:30.173117 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 19/36] 10.222.0.59 () {54 vars in 931 bytes} [Tue Oct 11 11:53:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 11:53:30.185129 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG dbcounter [-] [103752] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=103752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:30.602139 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-2329da13-1a69-4b42-bf06-8469a301ced1 admin admin] Calling method '>' {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:53:30.622258 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-2329da13-1a69-4b42-bf06-8469a301ced1 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.442437 Oct 11 11:53:30.622850 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 18/37] 10.222.0.59 () {60 vars in 1292 bytes} [Tue Oct 11 11:53:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 11:53:31.976280 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-07e7ea5a-0d1c-4a9d-8603-3e84c97393c8 admin admin] Calling method '>' {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:53:31.977296 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-07e7ea5a-0d1c-4a9d-8603-3e84c97393c8 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Oct 11 11:53:31.977714 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 20/38] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Oct 11 11:53:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 11:53:32.521878 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-dfeab0a5-fe77-425d-a4b3-180c7719aa2a admin admin] Calling method '>' {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:53:32.528080 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.wsgi [None req-dfeab0a5-fe77-425d-a4b3-180c7719aa2a admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 11 11:53:32.531406 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-dfeab0a5-fe77-425d-a4b3-180c7719aa2a admin admin] Request method failure captured: Oct 11 11:53:32.531406 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 11 11:53:32.531406 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: Accept: application/json Oct 11 11:53:32.531406 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: Accept-Encoding: gzip, deflate Oct 11 11:53:32.531406 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: Connection: keep-alive Oct 11 11:53:32.531406 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: Content-Length: 0 Oct 11 11:53:32.531406 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: Host: 10.222.0.59 Oct 11 11:53:32.531406 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: Openstack-Api-Version: compute 2.92 Oct 11 11:53:32.531406 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: Openstack-System-Scope: None Oct 11 11:53:32.531406 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: User-Agent: python-novaclient Oct 11 11:53:32.531406 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Auth-Token: gAAAAABjRVk7nsh-toSG7Hh88ThJkdNznK2CTCNGg3-t4VlkthiIer2DS0dT76K_uj9hqoSh73NKsI7XRCR8JA_e2tQHYwT0Yt4IMRQOCC3Cz9o2JaerxlieUgsnJKMBoIjzqPT3yc2i08hTcPddw7DpKvg1lm6eGp6XnVpb_GGNmcPtSATd__8 Oct 11 11:53:32.531406 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Domain-Id: None Oct 11 11:53:32.531406 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Domain-Name: None Oct 11 11:53:32.531406 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Identity-Status: Confirmed Oct 11 11:53:32.531406 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Is-Admin-Project: True Oct 11 11:53:32.531406 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 11:53:32.531406 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Project-Domain-Id: default Oct 11 11:53:32.531406 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Project-Domain-Name: Default Oct 11 11:53:32.531406 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Project-Id: ec9b5254352a410fb1f7cca5a5393294 Oct 11 11:53:32.531406 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Project-Name: admin Oct 11 11:53:32.531406 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Role: admin,reader,member Oct 11 11:53:32.531406 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Roles: admin,reader,member Oct 11 11:53:32.533045 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ec9b5254352a410fb1f7cca5a5393294"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ec9b5254352a410fb1f7cca5a5393294"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ec9b5254352a410fb1f7cca5a5393294"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ec9b5254352a410fb1f7cca5a5393294"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 11:53:32.533045 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Tenant: admin Oct 11 11:53:32.533045 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Tenant-Id: ec9b5254352a410fb1f7cca5a5393294 Oct 11 11:53:32.533045 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Tenant-Name: admin Oct 11 11:53:32.533045 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-User: admin Oct 11 11:53:32.533045 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-User-Domain-Id: default Oct 11 11:53:32.533045 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-User-Domain-Name: Default Oct 11 11:53:32.533045 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-User-Id: a1613582a9844c5fa354d54653ab8e01 Oct 11 11:53:32.533045 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-User-Name: admin Oct 11 11:53:32.533045 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: method: > Oct 11 11:53:32.533045 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: exception: Flavor 42 could not be found. Oct 11 11:53:32.533045 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: action_args: {'id': '42'} Oct 11 11:53:32.533045 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 11:53:32.533045 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 11:53:32.534353 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 11:53:32.534353 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 11:53:32.534353 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 11:53:32.534353 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 11:53:32.534353 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 11:53:32.534353 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 11:53:32.534353 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 11:53:32.534353 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 11:53:32.534353 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 11:53:32.534353 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 11:53:32.534353 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 11:53:32.534353 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 11:53:32.534353 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 11 11:53:32.534353 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi Oct 11 11:53:32.534353 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 11:53:32.534353 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi Oct 11 11:53:32.534353 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 11:53:32.534353 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 11:53:32.534353 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 11:53:32.535954 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 11:53:32.535954 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 11:53:32.535954 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 11:53:32.535954 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 11:53:32.535954 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 11:53:32.535954 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 11:53:32.535954 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 11 11:53:32.535954 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi Oct 11 11:53:32.535954 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 11:53:32.535954 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi Oct 11 11:53:32.535954 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 11:53:32.535954 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 11:53:32.535954 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 11:53:32.535954 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 11:53:32.535954 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 11:53:32.535954 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 11 11:53:32.535954 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi Oct 11 11:53:32.535954 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-dfeab0a5-fe77-425d-a4b3-180c7719aa2a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 11:53:32.537278 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-dfeab0a5-fe77-425d-a4b3-180c7719aa2a admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.420680 Oct 11 11:53:32.537278 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 19/39] 10.222.0.59 () {60 vars in 1190 bytes} [Tue Oct 11 11:53:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 422 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 11:53:32.542994 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-35a4fd99-0bf1-4abb-9d29-04820e232ce0 admin admin] Calling method '>' {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:53:32.547081 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG dbcounter [-] [103751] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=103751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:53:32.566979 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-35a4fd99-0bf1-4abb-9d29-04820e232ce0 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027510 Oct 11 11:53:32.567536 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 21/40] 10.222.0.59 () {60 vars in 1210 bytes} [Tue Oct 11 11:53:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 11:53:32.578460 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-e0938b65-2713-4d6b-99e5-4df373415512 admin admin] Calling method '>' {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:53:32.604863 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-e0938b65-2713-4d6b-99e5-4df373415512 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.030915 Oct 11 11:53:32.605426 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 20/41] 10.222.0.59 () {60 vars in 1210 bytes} [Tue Oct 11 11:53:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 11:53:32.615714 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-26365cbb-f598-4009-9014-c33af3bcc58b admin admin] Calling method '>' {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:53:32.621590 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.wsgi [None req-26365cbb-f598-4009-9014-c33af3bcc58b admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 11 11:53:32.624912 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-26365cbb-f598-4009-9014-c33af3bcc58b admin admin] Request method failure captured: Oct 11 11:53:32.624912 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 11 11:53:32.624912 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: Accept: application/json Oct 11 11:53:32.624912 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: Accept-Encoding: gzip, deflate Oct 11 11:53:32.624912 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: Connection: keep-alive Oct 11 11:53:32.624912 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: Content-Length: 0 Oct 11 11:53:32.624912 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: Host: 10.222.0.59 Oct 11 11:53:32.624912 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: Openstack-Api-Version: compute 2.92 Oct 11 11:53:32.624912 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: Openstack-System-Scope: None Oct 11 11:53:32.624912 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: User-Agent: python-novaclient Oct 11 11:53:32.624912 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Auth-Token: gAAAAABjRVk7nsh-toSG7Hh88ThJkdNznK2CTCNGg3-t4VlkthiIer2DS0dT76K_uj9hqoSh73NKsI7XRCR8JA_e2tQHYwT0Yt4IMRQOCC3Cz9o2JaerxlieUgsnJKMBoIjzqPT3yc2i08hTcPddw7DpKvg1lm6eGp6XnVpb_GGNmcPtSATd__8 Oct 11 11:53:32.624912 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Domain-Id: None Oct 11 11:53:32.624912 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Domain-Name: None Oct 11 11:53:32.624912 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Identity-Status: Confirmed Oct 11 11:53:32.624912 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Is-Admin-Project: True Oct 11 11:53:32.624912 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 11:53:32.624912 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Project-Domain-Id: default Oct 11 11:53:32.624912 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Project-Domain-Name: Default Oct 11 11:53:32.624912 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Project-Id: ec9b5254352a410fb1f7cca5a5393294 Oct 11 11:53:32.624912 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Project-Name: admin Oct 11 11:53:32.624912 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Role: admin,reader,member Oct 11 11:53:32.624912 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Roles: admin,reader,member Oct 11 11:53:32.626508 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ec9b5254352a410fb1f7cca5a5393294"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ec9b5254352a410fb1f7cca5a5393294"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ec9b5254352a410fb1f7cca5a5393294"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ec9b5254352a410fb1f7cca5a5393294"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 11:53:32.626508 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Tenant: admin Oct 11 11:53:32.626508 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Tenant-Id: ec9b5254352a410fb1f7cca5a5393294 Oct 11 11:53:32.626508 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Tenant-Name: admin Oct 11 11:53:32.626508 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-User: admin Oct 11 11:53:32.626508 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-User-Domain-Id: default Oct 11 11:53:32.626508 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-User-Domain-Name: Default Oct 11 11:53:32.626508 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-User-Id: a1613582a9844c5fa354d54653ab8e01 Oct 11 11:53:32.626508 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-User-Name: admin Oct 11 11:53:32.626508 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: method: > Oct 11 11:53:32.626508 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: exception: Flavor 42 could not be found. Oct 11 11:53:32.626508 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: action_args: {'id': '42'} Oct 11 11:53:32.626508 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 11:53:32.626508 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 11:53:32.627525 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 11:53:32.627525 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 11:53:32.627525 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 11:53:32.627525 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 11:53:32.627525 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 11:53:32.627525 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 11:53:32.627525 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 11:53:32.627525 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 11:53:32.627525 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 11:53:32.627525 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 11:53:32.627525 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 11:53:32.627525 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 11:53:32.627525 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 11 11:53:32.627525 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi Oct 11 11:53:32.627525 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 11:53:32.627525 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi Oct 11 11:53:32.627525 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 11:53:32.627525 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 11:53:32.627525 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 11:53:32.629124 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 11:53:32.629124 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 11:53:32.629124 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 11:53:32.629124 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 11:53:32.629124 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 11:53:32.629124 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 11:53:32.629124 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 11 11:53:32.629124 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi Oct 11 11:53:32.629124 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 11:53:32.629124 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi Oct 11 11:53:32.629124 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 11:53:32.629124 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 11:53:32.629124 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 11:53:32.629124 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 11:53:32.629124 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 11:53:32.629124 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 11 11:53:32.629124 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi Oct 11 11:53:32.629124 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-26365cbb-f598-4009-9014-c33af3bcc58b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 11:53:32.630413 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-26365cbb-f598-4009-9014-c33af3bcc58b admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014786 Oct 11 11:53:32.630413 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 22/42] 10.222.0.59 () {60 vars in 1190 bytes} [Tue Oct 11 11:53:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 11:53:33.856626 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-e0938b65-2713-4d6b-99e5-4df373415512 admin admin] Calling method '>' {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:53:33.857655 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-e0938b65-2713-4d6b-99e5-4df373415512 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Oct 11 11:53:33.858047 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 21/43] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Oct 11 11:53:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 11:53:34.423142 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-4f13bce3-4a8a-4998-8a33-d2fc1f94fa76 admin admin] Calling method '>' {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:53:34.428535 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.wsgi [None req-4f13bce3-4a8a-4998-8a33-d2fc1f94fa76 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 11 11:53:34.430143 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-4f13bce3-4a8a-4998-8a33-d2fc1f94fa76 admin admin] Request method failure captured: Oct 11 11:53:34.430143 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 11 11:53:34.430143 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: Accept: application/json Oct 11 11:53:34.430143 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: Accept-Encoding: gzip, deflate Oct 11 11:53:34.430143 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: Connection: keep-alive Oct 11 11:53:34.430143 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: Content-Length: 0 Oct 11 11:53:34.430143 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: Host: 10.222.0.59 Oct 11 11:53:34.430143 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: Openstack-Api-Version: compute 2.92 Oct 11 11:53:34.430143 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: Openstack-System-Scope: None Oct 11 11:53:34.430143 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: User-Agent: python-novaclient Oct 11 11:53:34.430143 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Auth-Token: gAAAAABjRVk976ovSZkOYlA10jKsXvFA5wsYU9g5BP_kEaJudNfzvmWgHECUOIomBlvdkpBb6d_2mcz4V-PDMTJYRaAs1zTnzdX81S-4HbdRQEINFTinrZxzeNprBiq1mIG_0wWbUwsEKaZwg3fssUAovsdQXsb2x6tXq7CLM2GmYjeUNYa15Mk Oct 11 11:53:34.430143 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Domain-Id: None Oct 11 11:53:34.430143 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Domain-Name: None Oct 11 11:53:34.430143 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Identity-Status: Confirmed Oct 11 11:53:34.430143 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Is-Admin-Project: True Oct 11 11:53:34.430143 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 11:53:34.430143 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Project-Domain-Id: default Oct 11 11:53:34.430143 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Project-Domain-Name: Default Oct 11 11:53:34.430143 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Project-Id: ec9b5254352a410fb1f7cca5a5393294 Oct 11 11:53:34.430143 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Project-Name: admin Oct 11 11:53:34.430143 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Role: admin,reader,member Oct 11 11:53:34.430143 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Roles: admin,reader,member Oct 11 11:53:34.431511 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ec9b5254352a410fb1f7cca5a5393294"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ec9b5254352a410fb1f7cca5a5393294"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ec9b5254352a410fb1f7cca5a5393294"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ec9b5254352a410fb1f7cca5a5393294"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 11:53:34.431511 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Tenant: admin Oct 11 11:53:34.431511 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Tenant-Id: ec9b5254352a410fb1f7cca5a5393294 Oct 11 11:53:34.431511 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Tenant-Name: admin Oct 11 11:53:34.431511 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-User: admin Oct 11 11:53:34.431511 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-User-Domain-Id: default Oct 11 11:53:34.431511 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-User-Domain-Name: Default Oct 11 11:53:34.431511 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-User-Id: a1613582a9844c5fa354d54653ab8e01 Oct 11 11:53:34.431511 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-User-Name: admin Oct 11 11:53:34.431511 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: method: > Oct 11 11:53:34.431511 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: exception: Flavor 84 could not be found. Oct 11 11:53:34.431511 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: action_args: {'id': '84'} Oct 11 11:53:34.431511 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 11:53:34.431511 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 11:53:34.432297 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 11:53:34.432297 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 11:53:34.432297 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 11:53:34.432297 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 11:53:34.432297 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 11:53:34.432297 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 11:53:34.432297 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 11:53:34.432297 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 11:53:34.432297 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 11:53:34.432297 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 11:53:34.432297 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 11:53:34.432297 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 11:53:34.432297 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 11 11:53:34.432297 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi Oct 11 11:53:34.432297 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 11:53:34.432297 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi Oct 11 11:53:34.432297 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 11:53:34.432297 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 11:53:34.432297 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 11:53:34.433474 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 11:53:34.433474 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 11:53:34.433474 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 11:53:34.433474 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 11:53:34.433474 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 11:53:34.433474 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 11:53:34.433474 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 11 11:53:34.433474 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi Oct 11 11:53:34.433474 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 11:53:34.433474 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi Oct 11 11:53:34.433474 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 11:53:34.433474 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 11:53:34.433474 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 11:53:34.433474 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 11:53:34.433474 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 11:53:34.433474 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 11 11:53:34.433474 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi Oct 11 11:53:34.433474 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-4f13bce3-4a8a-4998-8a33-d2fc1f94fa76 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 11:53:34.434799 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-4f13bce3-4a8a-4998-8a33-d2fc1f94fa76 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.435830 Oct 11 11:53:34.434799 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 23/44] 10.222.0.59 () {60 vars in 1190 bytes} [Tue Oct 11 11:53:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 437 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 11:53:34.442584 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-430ee735-9bb5-4865-a396-be2347a4faee admin admin] Calling method '>' {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:53:34.457901 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-430ee735-9bb5-4865-a396-be2347a4faee admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018934 Oct 11 11:53:34.458478 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 22/45] 10.222.0.59 () {60 vars in 1210 bytes} [Tue Oct 11 11:53:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 11:53:34.468465 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-1f1256ef-e337-41a1-91be-37f1f37b1daa admin admin] Calling method '>' {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:53:34.484585 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-1f1256ef-e337-41a1-91be-37f1f37b1daa admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019667 Oct 11 11:53:34.485138 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 24/46] 10.222.0.59 () {60 vars in 1210 bytes} [Tue Oct 11 11:53:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 11:53:34.494991 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-6921c01f-f492-4ce2-a6a6-b3bd9b17cfbf admin admin] Calling method '>' {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:53:34.500276 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.wsgi [None req-6921c01f-f492-4ce2-a6a6-b3bd9b17cfbf admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 11 11:53:34.501795 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-6921c01f-f492-4ce2-a6a6-b3bd9b17cfbf admin admin] Request method failure captured: Oct 11 11:53:34.501795 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 11 11:53:34.501795 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: Accept: application/json Oct 11 11:53:34.501795 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: Accept-Encoding: gzip, deflate Oct 11 11:53:34.501795 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: Connection: keep-alive Oct 11 11:53:34.501795 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: Content-Length: 0 Oct 11 11:53:34.501795 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: Host: 10.222.0.59 Oct 11 11:53:34.501795 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: Openstack-Api-Version: compute 2.92 Oct 11 11:53:34.501795 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: Openstack-System-Scope: None Oct 11 11:53:34.501795 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: User-Agent: python-novaclient Oct 11 11:53:34.501795 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Auth-Token: gAAAAABjRVk976ovSZkOYlA10jKsXvFA5wsYU9g5BP_kEaJudNfzvmWgHECUOIomBlvdkpBb6d_2mcz4V-PDMTJYRaAs1zTnzdX81S-4HbdRQEINFTinrZxzeNprBiq1mIG_0wWbUwsEKaZwg3fssUAovsdQXsb2x6tXq7CLM2GmYjeUNYa15Mk Oct 11 11:53:34.501795 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Domain-Id: None Oct 11 11:53:34.501795 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Domain-Name: None Oct 11 11:53:34.501795 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Identity-Status: Confirmed Oct 11 11:53:34.501795 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Is-Admin-Project: True Oct 11 11:53:34.501795 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 11:53:34.501795 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Project-Domain-Id: default Oct 11 11:53:34.501795 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Project-Domain-Name: Default Oct 11 11:53:34.501795 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Project-Id: ec9b5254352a410fb1f7cca5a5393294 Oct 11 11:53:34.501795 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Project-Name: admin Oct 11 11:53:34.501795 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Role: admin,reader,member Oct 11 11:53:34.501795 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Roles: admin,reader,member Oct 11 11:53:34.503223 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ec9b5254352a410fb1f7cca5a5393294"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ec9b5254352a410fb1f7cca5a5393294"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ec9b5254352a410fb1f7cca5a5393294"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ec9b5254352a410fb1f7cca5a5393294"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 11:53:34.503223 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Tenant: admin Oct 11 11:53:34.503223 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Tenant-Id: ec9b5254352a410fb1f7cca5a5393294 Oct 11 11:53:34.503223 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Tenant-Name: admin Oct 11 11:53:34.503223 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-User: admin Oct 11 11:53:34.503223 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-User-Domain-Id: default Oct 11 11:53:34.503223 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-User-Domain-Name: Default Oct 11 11:53:34.503223 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-User-Id: a1613582a9844c5fa354d54653ab8e01 Oct 11 11:53:34.503223 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-User-Name: admin Oct 11 11:53:34.503223 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: method: > Oct 11 11:53:34.503223 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: exception: Flavor 84 could not be found. Oct 11 11:53:34.503223 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: action_args: {'id': '84'} Oct 11 11:53:34.503223 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 11:53:34.503223 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 11:53:34.504004 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 11:53:34.504004 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 11:53:34.504004 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 11:53:34.504004 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 11:53:34.504004 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 11:53:34.504004 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 11:53:34.504004 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 11:53:34.504004 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 11:53:34.504004 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 11:53:34.504004 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 11:53:34.504004 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 11:53:34.504004 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 11:53:34.504004 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 11 11:53:34.504004 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi Oct 11 11:53:34.504004 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 11:53:34.504004 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi Oct 11 11:53:34.504004 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 11:53:34.504004 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 11:53:34.504004 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 11:53:34.505055 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 11:53:34.505055 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 11:53:34.505055 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 11:53:34.505055 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 11:53:34.505055 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 11:53:34.505055 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 11:53:34.505055 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 11 11:53:34.505055 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi Oct 11 11:53:34.505055 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 11:53:34.505055 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi Oct 11 11:53:34.505055 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 11:53:34.505055 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 11:53:34.505055 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 11:53:34.505055 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 11:53:34.505055 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 11:53:34.505055 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 11 11:53:34.505055 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi Oct 11 11:53:34.505055 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-6921c01f-f492-4ce2-a6a6-b3bd9b17cfbf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 11:53:34.506067 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-6921c01f-f492-4ce2-a6a6-b3bd9b17cfbf admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011813 Oct 11 11:53:34.506067 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 23/47] 10.222.0.59 () {60 vars in 1190 bytes} [Tue Oct 11 11:53:34 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 11:53:35.735716 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-1f1256ef-e337-41a1-91be-37f1f37b1daa admin admin] Calling method '>' {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:53:35.736725 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-1f1256ef-e337-41a1-91be-37f1f37b1daa admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Oct 11 11:53:35.737219 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 25/48] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Oct 11 11:53:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 11:53:36.303542 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-ae814d63-e5b0-480d-8c6c-22ab295535d6 admin admin] Calling method '>' {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:53:36.309881 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.wsgi [None req-ae814d63-e5b0-480d-8c6c-22ab295535d6 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 11 11:53:36.311436 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-ae814d63-e5b0-480d-8c6c-22ab295535d6 admin admin] Request method failure captured: Oct 11 11:53:36.311436 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 11 11:53:36.311436 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: Accept: application/json Oct 11 11:53:36.311436 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: Accept-Encoding: gzip, deflate Oct 11 11:53:36.311436 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: Connection: keep-alive Oct 11 11:53:36.311436 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: Content-Length: 0 Oct 11 11:53:36.311436 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: Host: 10.222.0.59 Oct 11 11:53:36.311436 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: Openstack-Api-Version: compute 2.92 Oct 11 11:53:36.311436 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: Openstack-System-Scope: None Oct 11 11:53:36.311436 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: User-Agent: python-novaclient Oct 11 11:53:36.311436 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Auth-Token: gAAAAABjRVk_6bf_hO7gl6UPe6rWG0buR2zMCoRbM_65VLOIuVg9Ij2zE9PYRd6Qz8h0hpVWMG4XKbm5RZ2wRD6PepZZA-SYp5iXU7ZudXIk286o-VJsznk6YTExF5pDTuKNOiAk5QUUNk5wBmzwCJNYKGdSUdetE9u8gwKLsQmyI6wsg7e5s5k Oct 11 11:53:36.311436 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Domain-Id: None Oct 11 11:53:36.311436 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Domain-Name: None Oct 11 11:53:36.311436 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Identity-Status: Confirmed Oct 11 11:53:36.311436 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Is-Admin-Project: True Oct 11 11:53:36.311436 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 11:53:36.311436 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Project-Domain-Id: default Oct 11 11:53:36.311436 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Project-Domain-Name: Default Oct 11 11:53:36.311436 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Project-Id: ec9b5254352a410fb1f7cca5a5393294 Oct 11 11:53:36.311436 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Project-Name: admin Oct 11 11:53:36.311436 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Role: admin,reader,member Oct 11 11:53:36.311436 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Roles: admin,reader,member Oct 11 11:53:36.312994 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ec9b5254352a410fb1f7cca5a5393294"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ec9b5254352a410fb1f7cca5a5393294"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ec9b5254352a410fb1f7cca5a5393294"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ec9b5254352a410fb1f7cca5a5393294"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 11:53:36.312994 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Tenant: admin Oct 11 11:53:36.312994 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Tenant-Id: ec9b5254352a410fb1f7cca5a5393294 Oct 11 11:53:36.312994 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-Tenant-Name: admin Oct 11 11:53:36.312994 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-User: admin Oct 11 11:53:36.312994 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-User-Domain-Id: default Oct 11 11:53:36.312994 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-User-Domain-Name: Default Oct 11 11:53:36.312994 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-User-Id: a1613582a9844c5fa354d54653ab8e01 Oct 11 11:53:36.312994 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: X-User-Name: admin Oct 11 11:53:36.312994 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: method: > Oct 11 11:53:36.312994 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: exception: Flavor 451 could not be found. Oct 11 11:53:36.312994 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: action_args: {'id': '451'} Oct 11 11:53:36.312994 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 11:53:36.312994 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 11:53:36.313916 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 11:53:36.313916 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 11:53:36.313916 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 11:53:36.313916 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 11:53:36.313916 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 11:53:36.313916 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 11:53:36.313916 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 11:53:36.313916 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 11:53:36.313916 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 11:53:36.313916 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 11:53:36.313916 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 11:53:36.313916 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 11:53:36.313916 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 11 11:53:36.313916 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi Oct 11 11:53:36.313916 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 11:53:36.313916 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi Oct 11 11:53:36.313916 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 11:53:36.313916 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 11:53:36.313916 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 11:53:36.315040 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 11:53:36.315040 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 11:53:36.315040 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 11:53:36.315040 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 11:53:36.315040 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 11:53:36.315040 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 11:53:36.315040 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 11 11:53:36.315040 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi Oct 11 11:53:36.315040 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 11:53:36.315040 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi Oct 11 11:53:36.315040 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 11:53:36.315040 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 11:53:36.315040 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 11:53:36.315040 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 11:53:36.315040 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 11:53:36.315040 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 11 11:53:36.315040 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: ERROR nova.api.openstack.wsgi Oct 11 11:53:36.315040 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-ae814d63-e5b0-480d-8c6c-22ab295535d6 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103752) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 11:53:36.316120 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-ae814d63-e5b0-480d-8c6c-22ab295535d6 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.440995 Oct 11 11:53:36.316120 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 24/49] 10.222.0.59 () {60 vars in 1193 bytes} [Tue Oct 11 11:53:35 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 442 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 11:53:36.324984 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-55646edd-9bbb-4a4b-8d2e-6778ed265331 admin admin] Calling method '>' {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:53:36.346137 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-55646edd-9bbb-4a4b-8d2e-6778ed265331 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025651 Oct 11 11:53:36.346850 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 26/50] 10.222.0.59 () {60 vars in 1210 bytes} [Tue Oct 11 11:53:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 11:53:36.357431 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-f9c290d9-b687-4a4d-a71b-afcbb34f998c admin admin] Calling method '>' {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:53:36.373426 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-f9c290d9-b687-4a4d-a71b-afcbb34f998c admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019749 Oct 11 11:53:36.373980 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 25/51] 10.222.0.59 () {60 vars in 1210 bytes} [Tue Oct 11 11:53:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 11:53:36.383967 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-b45b7d0e-5101-40fd-9db5-d8420d52caec admin admin] Calling method '>' {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:53:36.389299 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.wsgi [None req-b45b7d0e-5101-40fd-9db5-d8420d52caec admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 11 11:53:36.390880 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-b45b7d0e-5101-40fd-9db5-d8420d52caec admin admin] Request method failure captured: Oct 11 11:53:36.390880 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 11 11:53:36.390880 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: Accept: application/json Oct 11 11:53:36.390880 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: Accept-Encoding: gzip, deflate Oct 11 11:53:36.390880 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: Connection: keep-alive Oct 11 11:53:36.390880 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: Content-Length: 0 Oct 11 11:53:36.390880 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: Host: 10.222.0.59 Oct 11 11:53:36.390880 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: Openstack-Api-Version: compute 2.92 Oct 11 11:53:36.390880 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: Openstack-System-Scope: None Oct 11 11:53:36.390880 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: User-Agent: python-novaclient Oct 11 11:53:36.390880 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Auth-Token: gAAAAABjRVk_6bf_hO7gl6UPe6rWG0buR2zMCoRbM_65VLOIuVg9Ij2zE9PYRd6Qz8h0hpVWMG4XKbm5RZ2wRD6PepZZA-SYp5iXU7ZudXIk286o-VJsznk6YTExF5pDTuKNOiAk5QUUNk5wBmzwCJNYKGdSUdetE9u8gwKLsQmyI6wsg7e5s5k Oct 11 11:53:36.390880 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Domain-Id: None Oct 11 11:53:36.390880 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Domain-Name: None Oct 11 11:53:36.390880 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Identity-Status: Confirmed Oct 11 11:53:36.390880 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Is-Admin-Project: True Oct 11 11:53:36.390880 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 11:53:36.390880 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Project-Domain-Id: default Oct 11 11:53:36.390880 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Project-Domain-Name: Default Oct 11 11:53:36.390880 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Project-Id: ec9b5254352a410fb1f7cca5a5393294 Oct 11 11:53:36.390880 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Project-Name: admin Oct 11 11:53:36.390880 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Role: admin,reader,member Oct 11 11:53:36.390880 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Roles: admin,reader,member Oct 11 11:53:36.392905 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ec9b5254352a410fb1f7cca5a5393294"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ec9b5254352a410fb1f7cca5a5393294"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ec9b5254352a410fb1f7cca5a5393294"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ec9b5254352a410fb1f7cca5a5393294"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 11:53:36.392905 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Tenant: admin Oct 11 11:53:36.392905 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Tenant-Id: ec9b5254352a410fb1f7cca5a5393294 Oct 11 11:53:36.392905 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-Tenant-Name: admin Oct 11 11:53:36.392905 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-User: admin Oct 11 11:53:36.392905 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-User-Domain-Id: default Oct 11 11:53:36.392905 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-User-Domain-Name: Default Oct 11 11:53:36.392905 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-User-Id: a1613582a9844c5fa354d54653ab8e01 Oct 11 11:53:36.392905 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: X-User-Name: admin Oct 11 11:53:36.392905 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: method: > Oct 11 11:53:36.392905 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: exception: Flavor 451 could not be found. Oct 11 11:53:36.392905 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: action_args: {'id': '451'} Oct 11 11:53:36.392905 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 11:53:36.392905 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 11:53:36.393977 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 11:53:36.393977 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 11:53:36.393977 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 11:53:36.393977 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 11:53:36.393977 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 11:53:36.393977 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 11:53:36.393977 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 11:53:36.393977 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 11:53:36.393977 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 11:53:36.393977 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 11:53:36.393977 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 11:53:36.393977 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 11:53:36.393977 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 11 11:53:36.393977 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi Oct 11 11:53:36.393977 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 11:53:36.393977 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi Oct 11 11:53:36.393977 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 11:53:36.393977 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 11:53:36.393977 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 11:53:36.395386 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 11:53:36.395386 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 11:53:36.395386 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 11:53:36.395386 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 11:53:36.395386 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 11:53:36.395386 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 11:53:36.395386 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 11 11:53:36.395386 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi Oct 11 11:53:36.395386 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 11:53:36.395386 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi Oct 11 11:53:36.395386 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 11:53:36.395386 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 11:53:36.395386 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 11:53:36.395386 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 11:53:36.395386 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 11:53:36.395386 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 11 11:53:36.395386 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: ERROR nova.api.openstack.wsgi Oct 11 11:53:36.395386 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-b45b7d0e-5101-40fd-9db5-d8420d52caec admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103751) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 11:53:36.396705 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-b45b7d0e-5101-40fd-9db5-d8420d52caec admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012049 Oct 11 11:53:36.396705 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 27/52] 10.222.0.59 () {60 vars in 1193 bytes} [Tue Oct 11 11:53:36 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 11:53:37.634514 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-f9c290d9-b687-4a4d-a71b-afcbb34f998c admin admin] Calling method '>' {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:53:37.635573 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-f9c290d9-b687-4a4d-a71b-afcbb34f998c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Oct 11 11:53:37.635980 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 26/53] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Oct 11 11:53:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 11:53:38.196468 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-795a7ee3-866e-499c-9e75-42aab386d4bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 11:53:38.218177 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-795a7ee3-866e-499c-9e75-42aab386d4bf admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.446511 Oct 11 11:53:38.218824 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 28/54] 10.222.0.59 () {64 vars in 1235 bytes} [Tue Oct 11 11:53:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 11:53:39.464829 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-f9c290d9-b687-4a4d-a71b-afcbb34f998c admin admin] Calling method '>' {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:53:39.465847 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-f9c290d9-b687-4a4d-a71b-afcbb34f998c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 11 11:53:39.466244 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 27/55] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Oct 11 11:53:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 11:53:40.015613 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-9bb95e59-7fb3-4222-b311-87af131da84d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 11:53:40.037483 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-9bb95e59-7fb3-4222-b311-87af131da84d admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.434501 Oct 11 11:53:40.038055 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 29/56] 10.222.0.59 () {64 vars in 1235 bytes} [Tue Oct 11 11:53:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 11:53:41.287969 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-f9c290d9-b687-4a4d-a71b-afcbb34f998c admin admin] Calling method '>' {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:53:41.289024 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-f9c290d9-b687-4a4d-a71b-afcbb34f998c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Oct 11 11:53:41.289424 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 28/57] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Oct 11 11:53:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 11:53:41.846638 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-1ba3080e-5edf-43d5-b7d5-4a3bfcb32f69 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 11:53:41.867594 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-1ba3080e-5edf-43d5-b7d5-4a3bfcb32f69 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.443749 Oct 11 11:53:41.868128 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 30/58] 10.222.0.59 () {64 vars in 1235 bytes} [Tue Oct 11 11:53:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 11:53:43.112515 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-f9c290d9-b687-4a4d-a71b-afcbb34f998c admin admin] Calling method '>' {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:53:43.113540 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-f9c290d9-b687-4a4d-a71b-afcbb34f998c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001546 Oct 11 11:53:43.113931 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 29/59] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Oct 11 11:53:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 11:53:43.726183 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-e60af42e-a385-42d8-8d43-a1e6daadcab5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 11:53:43.746732 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-e60af42e-a385-42d8-8d43-a1e6daadcab5 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.497380 Oct 11 11:53:43.747345 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 31/60] 10.222.0.59 () {64 vars in 1235 bytes} [Tue Oct 11 11:53:43 2022] POST /compute/v2.1/flavors => generated 409 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 11:53:44.997421 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-f9c290d9-b687-4a4d-a71b-afcbb34f998c admin admin] Calling method '>' {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:53:44.998465 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-f9c290d9-b687-4a4d-a71b-afcbb34f998c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001562 Oct 11 11:53:44.998881 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 30/61] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Oct 11 11:53:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 11:53:45.542047 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-4adcef24-162c-4d86-b0ac-ac8ad05e026e admin admin] Calling method '>' {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:53:45.562751 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-4adcef24-162c-4d86-b0ac-ac8ad05e026e admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.428502 Oct 11 11:53:45.563308 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 32/62] 10.222.0.59 () {60 vars in 1202 bytes} [Tue Oct 11 11:53:45 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 11:54:43.280137 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-f9c290d9-b687-4a4d-a71b-afcbb34f998c admin admin] Calling method '>' {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:54:43.281167 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-f9c290d9-b687-4a4d-a71b-afcbb34f998c admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001599 Oct 11 11:54:43.281574 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 31/63] 10.222.0.59 () {54 vars in 931 bytes} [Tue Oct 11 11:54:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 11:54:43.292719 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG dbcounter [-] [103751] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:54:43.701850 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-4924f61d-0f83-42b1-81b8-3c80adca8e55 admin admin] Calling method '>' {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:54:43.723312 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-4924f61d-0f83-42b1-81b8-3c80adca8e55 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.434890 Oct 11 11:54:43.723753 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 33/64] 10.222.0.59 () {60 vars in 1292 bytes} [Tue Oct 11 11:54:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 11:54:43.745271 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG dbcounter [-] [103752] Writing DB stats nova_api:SELECT=14 {{(pid=103752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:54:43.749817 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-1dc15875-18b6-4128-86c4-b569edd57383 admin admin] Calling method '>' {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:54:43.757941 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-1dc15875-18b6-4128-86c4-b569edd57383 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014326 Oct 11 11:54:43.758514 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 32/65] 10.222.0.59 () {60 vars in 1283 bytes} [Tue Oct 11 11:54:43 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 11:54:43.771317 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-7601f77e-1f3c-459d-a541-c497be2622d2 admin admin] Calling method '>' {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:54:43.779615 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-7601f77e-1f3c-459d-a541-c497be2622d2 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011859 Oct 11 11:54:43.780180 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 34/66] 10.222.0.59 () {60 vars in 1286 bytes} [Tue Oct 11 11:54:43 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 11:54:43.793202 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-9d5d4ec5-c4c7-499c-9fcf-1d4a0d012986 admin admin] Calling method '>' {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:54:43.805912 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-9d5d4ec5-c4c7-499c-9fcf-1d4a0d012986 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.017105 Oct 11 11:54:43.806507 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 33/67] 10.222.0.59 () {60 vars in 1286 bytes} [Tue Oct 11 11:54:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 11:54:43.819588 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-fada8cae-4aeb-4d45-9306-3332a221b445 admin admin] Calling method '>' {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:54:43.827871 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-fada8cae-4aeb-4d45-9306-3332a221b445 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012211 Oct 11 11:54:43.828523 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 35/68] 10.222.0.59 () {60 vars in 1283 bytes} [Tue Oct 11 11:54:43 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 11:57:50.846140 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-9d5d4ec5-c4c7-499c-9fcf-1d4a0d012986 admin admin] Calling method '>' {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:57:50.847144 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-9d5d4ec5-c4c7-499c-9fcf-1d4a0d012986 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Oct 11 11:57:50.847572 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 34/69] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Oct 11 11:57:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 11:57:50.987160 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG dbcounter [-] [103751] Writing DB stats nova_api:SELECT=6 {{(pid=103751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:57:51.165539 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-1000972d-4386-4945-acf6-5298ad651bb4 admin admin] Calling method '>' {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:57:51.170463 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG oslo_concurrency.lockutils [None req-1000972d-4386-4945-acf6-5298ad651bb4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 11:57:51.170961 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG oslo_concurrency.lockutils [None req-1000972d-4386-4945-acf6-5298ad651bb4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 11:57:51.171384 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG oslo_concurrency.lockutils [None req-1000972d-4386-4945-acf6-5298ad651bb4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 11:57:51.172086 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG oslo_concurrency.lockutils [None req-1000972d-4386-4945-acf6-5298ad651bb4 admin admin] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 11:57:51.172530 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG oslo_concurrency.lockutils [None req-1000972d-4386-4945-acf6-5298ad651bb4 admin admin] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 11:57:51.172935 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG oslo_concurrency.lockutils [None req-1000972d-4386-4945-acf6-5298ad651bb4 admin admin] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 11:57:51.204455 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-1000972d-4386-4945-acf6-5298ad651bb4 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.218395 Oct 11 11:57:51.205040 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 36/70] 10.222.0.59 () {60 vars in 1193 bytes} [Tue Oct 11 11:57:50 2022] GET /compute/v2.1/os-services => generated 791 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 11:57:52.319375 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-9d5d4ec5-c4c7-499c-9fcf-1d4a0d012986 admin admin] Calling method '>' {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:57:52.320675 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-9d5d4ec5-c4c7-499c-9fcf-1d4a0d012986 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002009 Oct 11 11:57:52.321183 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 35/71] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Oct 11 11:57:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 11:57:52.525850 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-9b576560-7ce2-47b7-9ad7-f2b5286e51c4 admin admin] Calling method '>' {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:57:52.529389 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG oslo_concurrency.lockutils [None req-9b576560-7ce2-47b7-9ad7-f2b5286e51c4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 11:57:52.530282 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG oslo_concurrency.lockutils [None req-9b576560-7ce2-47b7-9ad7-f2b5286e51c4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 11:57:52.530766 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG oslo_concurrency.lockutils [None req-9b576560-7ce2-47b7-9ad7-f2b5286e51c4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 11:57:52.531477 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG oslo_concurrency.lockutils [None req-9b576560-7ce2-47b7-9ad7-f2b5286e51c4 admin admin] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 11:57:52.531917 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG oslo_concurrency.lockutils [None req-9b576560-7ce2-47b7-9ad7-f2b5286e51c4 admin admin] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 11:57:52.532324 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG oslo_concurrency.lockutils [None req-9b576560-7ce2-47b7-9ad7-f2b5286e51c4 admin admin] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 11:57:52.551900 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-9b576560-7ce2-47b7-9ad7-f2b5286e51c4 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.090851 Oct 11 11:57:52.552474 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 37/72] 10.222.0.59 () {60 vars in 1193 bytes} [Tue Oct 11 11:57:52 2022] GET /compute/v2.1/os-services => generated 791 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 11:58:04.049582 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-9d5d4ec5-c4c7-499c-9fcf-1d4a0d012986 admin admin] Calling method '>' {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:58:04.050587 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-9d5d4ec5-c4c7-499c-9fcf-1d4a0d012986 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Oct 11 11:58:04.051015 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 36/73] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Oct 11 11:58:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 11:58:04.196809 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG dbcounter [-] [103751] Writing DB stats nova_cell0:SELECT=4 {{(pid=103751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:58:04.197661 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG dbcounter [-] [103751] Writing DB stats nova_cell1:SELECT=4 {{(pid=103751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:58:04.198335 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG dbcounter [-] [103751] Writing DB stats nova_api:SELECT=8 {{(pid=103751) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:58:04.254192 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-055d9e8a-3003-4571-abf4-16072ee24184 admin admin] Calling method '>' {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:58:04.257551 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG oslo_concurrency.lockutils [None req-055d9e8a-3003-4571-abf4-16072ee24184 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 11:58:04.258023 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG oslo_concurrency.lockutils [None req-055d9e8a-3003-4571-abf4-16072ee24184 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 11:58:04.258445 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG oslo_concurrency.lockutils [None req-055d9e8a-3003-4571-abf4-16072ee24184 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 11:58:04.259212 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG oslo_concurrency.lockutils [None req-055d9e8a-3003-4571-abf4-16072ee24184 admin admin] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 11:58:04.259649 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG oslo_concurrency.lockutils [None req-055d9e8a-3003-4571-abf4-16072ee24184 admin admin] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 11:58:04.260061 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG oslo_concurrency.lockutils [None req-055d9e8a-3003-4571-abf4-16072ee24184 admin admin] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 11:58:04.285337 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-055d9e8a-3003-4571-abf4-16072ee24184 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.095749 Oct 11 11:58:04.285895 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 38/74] 10.222.0.59 () {60 vars in 1193 bytes} [Tue Oct 11 11:58:04 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 11:58:05.372175 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG nova.api.openstack.wsgi [None req-9d5d4ec5-c4c7-499c-9fcf-1d4a0d012986 admin admin] Calling method '>' {{(pid=103752) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:58:05.373245 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: INFO nova.api.openstack.requestlog [None req-9d5d4ec5-c4c7-499c-9fcf-1d4a0d012986 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Oct 11 11:58:05.373643 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: [pid: 103752|app: 0|req: 37/75] 10.222.0.59 () {56 vars in 1074 bytes} [Tue Oct 11 11:58:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 11:58:05.582763 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG nova.api.openstack.wsgi [None req-a70945c7-d7f7-4189-aa64-d39d6ad7e7c3 admin admin] Calling method '>' {{(pid=103751) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:58:05.586158 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG oslo_concurrency.lockutils [None req-a70945c7-d7f7-4189-aa64-d39d6ad7e7c3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 11:58:05.586745 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG oslo_concurrency.lockutils [None req-a70945c7-d7f7-4189-aa64-d39d6ad7e7c3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 11:58:05.587073 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG oslo_concurrency.lockutils [None req-a70945c7-d7f7-4189-aa64-d39d6ad7e7c3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 11:58:05.587772 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG oslo_concurrency.lockutils [None req-a70945c7-d7f7-4189-aa64-d39d6ad7e7c3 admin admin] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 11:58:05.588214 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG oslo_concurrency.lockutils [None req-a70945c7-d7f7-4189-aa64-d39d6ad7e7c3 admin admin] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 11:58:05.588619 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: DEBUG oslo_concurrency.lockutils [None req-a70945c7-d7f7-4189-aa64-d39d6ad7e7c3 admin admin] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103751) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 11:58:05.610376 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: INFO nova.api.openstack.requestlog [None req-a70945c7-d7f7-4189-aa64-d39d6ad7e7c3 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.091876 Oct 11 11:58:05.611178 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: [pid: 103751|app: 0|req: 39/76] 10.222.0.59 () {60 vars in 1193 bytes} [Tue Oct 11 11:58:05 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 11:59:03.898189 dv-cinder-820994-6-iscsi devstack@n-api.service[103750]: Tue Oct 11 11:59:03 2022 - graceful shutdown triggered... Oct 11 11:59:03.898149 dv-cinder-820994-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 11 11:59:03.899205 dv-cinder-820994-6-iscsi devstack@n-api.service[103751]: Gracefully killing worker 1 (pid: 103751)... Oct 11 11:59:03.899568 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: Gracefully killing worker 2 (pid: 103752)... Oct 11 11:59:04.027870 dv-cinder-820994-6-iscsi devstack@n-api.service[103752]: DEBUG dbcounter [-] [103752] Writing DB stats nova_api:SELECT=4 {{(pid=103752) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:59:04.898750 dv-cinder-820994-6-iscsi devstack@n-api.service[103750]: worker 1 buried after 1 seconds Oct 11 11:59:04.898750 dv-cinder-820994-6-iscsi devstack@n-api.service[103750]: worker 2 buried after 1 seconds Oct 11 11:59:04.898750 dv-cinder-820994-6-iscsi devstack@n-api.service[103750]: goodbye to uWSGI. Oct 11 11:59:04.900605 dv-cinder-820994-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 11 11:59:04.901163 dv-cinder-820994-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 11 11:59:04.904270 dv-cinder-820994-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 11 11:59:04.917145 dv-cinder-820994-6-iscsi devstack@n-api.service[118979]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 11 11:59:04.919147 dv-cinder-820994-6-iscsi devstack@n-api.service[118979]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 11 11:59:04 2022] *** Oct 11 11:59:04.919147 dv-cinder-820994-6-iscsi devstack@n-api.service[118979]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 11 11:59:04.919147 dv-cinder-820994-6-iscsi devstack@n-api.service[118979]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 11 11:59:04.919147 dv-cinder-820994-6-iscsi devstack@n-api.service[118979]: nodename: dv-cinder-820994-6-iscsi Oct 11 11:59:04.919147 dv-cinder-820994-6-iscsi devstack@n-api.service[118979]: machine: x86_64 Oct 11 11:59:04.919147 dv-cinder-820994-6-iscsi devstack@n-api.service[118979]: clock source: unix Oct 11 11:59:04.919147 dv-cinder-820994-6-iscsi devstack@n-api.service[118979]: pcre jit disabled Oct 11 11:59:04.919147 dv-cinder-820994-6-iscsi devstack@n-api.service[118979]: detected number of CPU cores: 4 Oct 11 11:59:04.919147 dv-cinder-820994-6-iscsi devstack@n-api.service[118979]: current working directory: / Oct 11 11:59:04.919147 dv-cinder-820994-6-iscsi devstack@n-api.service[118979]: detected binary path: /usr/bin/uwsgi-core Oct 11 11:59:04.919909 dv-cinder-820994-6-iscsi devstack@n-api.service[118979]: your processes number limit is 47680 Oct 11 11:59:04.919909 dv-cinder-820994-6-iscsi devstack@n-api.service[118979]: your memory page size is 4096 bytes Oct 11 11:59:04.919909 dv-cinder-820994-6-iscsi devstack@n-api.service[118979]: detected max file descriptor number: 2048 Oct 11 11:59:04.919909 dv-cinder-820994-6-iscsi devstack@n-api.service[118979]: lock engine: pthread robust mutexes Oct 11 11:59:04.919909 dv-cinder-820994-6-iscsi devstack@n-api.service[118979]: thunder lock: enabled Oct 11 11:59:04.919909 dv-cinder-820994-6-iscsi devstack@n-api.service[118979]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 11 11:59:04.919909 dv-cinder-820994-6-iscsi devstack@n-api.service[118979]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 11 11:59:04.961413 dv-cinder-820994-6-iscsi devstack@n-api.service[118979]: Python main interpreter initialized at 0x5618e643d9c0 Oct 11 11:59:04.961413 dv-cinder-820994-6-iscsi devstack@n-api.service[118979]: python threads support enabled Oct 11 11:59:04.961413 dv-cinder-820994-6-iscsi devstack@n-api.service[118979]: your server socket listen backlog is limited to 100 connections Oct 11 11:59:04.961413 dv-cinder-820994-6-iscsi devstack@n-api.service[118979]: your mercy for graceful operations on workers is 90 seconds Oct 11 11:59:04.961864 dv-cinder-820994-6-iscsi devstack@n-api.service[118979]: mapped 403077 bytes (393 KB) for 2 cores Oct 11 11:59:04.961864 dv-cinder-820994-6-iscsi devstack@n-api.service[118979]: *** Operational MODE: preforking *** Oct 11 11:59:04.962347 dv-cinder-820994-6-iscsi devstack@n-api.service[118979]: *** uWSGI is running in multiple interpreter mode *** Oct 11 11:59:04.962347 dv-cinder-820994-6-iscsi devstack@n-api.service[118979]: spawned uWSGI master process (pid: 118979) Oct 11 11:59:04.962524 dv-cinder-820994-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 11 11:59:04.963413 dv-cinder-820994-6-iscsi devstack@n-api.service[118979]: spawned uWSGI worker 1 (pid: 118994, cores: 1) Oct 11 11:59:04.964843 dv-cinder-820994-6-iscsi devstack@n-api.service[118979]: spawned uWSGI worker 2 (pid: 118995, cores: 1) Oct 11 11:59:04.964843 dv-cinder-820994-6-iscsi devstack@n-api.service[118979]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 11 11:59:05.634833 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 11 11:59:05.636835 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 11 11:59:06.816186 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 11:59:06.816186 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: from cryptography.utils import int_from_bytes Oct 11 11:59:06.816865 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 11:59:06.816865 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: from cryptography.utils import int_from_bytes Oct 11 11:59:06.831379 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 11:59:06.831379 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: from cryptography.utils import int_from_bytes Oct 11 11:59:06.831993 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 11:59:06.831993 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: from cryptography.utils import int_from_bytes Oct 11 11:59:09.264274 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 11 11:59:09.264813 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 11 11:59:09.265088 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 11 11:59:09.265362 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 11 11:59:09.265613 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 11 11:59:09.266003 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.266322 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.266663 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.266981 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.267310 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.267629 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.267948 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.268252 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.268586 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.268844 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.269152 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.269645 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820994-6-iscsi {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.269967 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.270273 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.270642 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.271008 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.271283 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.271604 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.271920 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.272424 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.273989 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.273989 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.273989 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.273989 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.274543 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.274543 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.274991 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.274991 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.275412 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.275633 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.276007 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820994-6-iscsi {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.276305 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.276601 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.276910 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.277338 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.277629 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.277944 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.278261 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.278609 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.279236 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.279567 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.280508 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.280508 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.280508 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.280955 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.281135 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.281379 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.281702 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.282100 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.282299 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.282510 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.283025 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.283203 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.284305 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.284305 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.284305 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.284799 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.284799 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.285170 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.285333 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.285611 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.285914 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.286221 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.286871 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.286871 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.287209 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.287503 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.287811 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.288112 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.288445 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.288745 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.289064 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.289480 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.289730 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.290040 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.290372 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.290710 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.291027 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.291347 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.291669 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.291977 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.292301 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.292602 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.292902 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.293240 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.293539 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.293797 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.294116 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.294411 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.294838 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.295018 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.295335 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.295637 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.295919 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.296419 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.296902 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.297209 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.297561 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.297810 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.298119 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.298423 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.298758 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.299067 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.299370 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.299691 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.300008 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.300315 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.300621 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.300930 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.301233 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.301549 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.301879 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.302274 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.302621 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.302930 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.303232 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.303549 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.303855 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.304161 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.304475 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.304774 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.305079 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.305392 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.305698 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.306001 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.306302 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.306621 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.306928 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.307230 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.307530 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.307831 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.308128 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.308445 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.308763 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.309069 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.309374 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.309675 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.309990 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.310328 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.310675 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.311025 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.311338 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.311668 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.311996 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.312313 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.312619 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.312929 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.313251 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.313558 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.313868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.314175 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.314491 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.314731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 11 11:59:09.315177 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.315299 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 11 11:59:09.315419 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.315535 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 11 11:59:09.315651 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.315774 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.315881 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 11 11:59:09.315996 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 11 11:59:09.316103 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.316339 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.316455 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.316654 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.316771 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.316977 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.318382 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.318605 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.319610 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.319716 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.319806 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.319806 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.319970 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.320062 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.320161 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.320161 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.320308 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.320401 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.320485 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.320566 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.320657 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.320741 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.320822 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.320903 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.320996 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-820994-6-iscsi {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.321093 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.321183 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.321274 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.321367 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.321457 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.321550 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.321648 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.321741 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.321835 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.321918 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.321999 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.322080 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.322171 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.322267 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.322365 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.322631 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.322783 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.322934 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.323054 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.323241 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.323372 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.323550 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.323687 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.323935 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.324037 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.324190 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.324283 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.324497 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.324596 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.324811 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.324910 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.325118 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.325210 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.325430 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.325520 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.325742 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.325844 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.326049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.326157 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-820994-6-iscsi {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.326358 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.326453 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.326690 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.326797 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.326996 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.327089 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.327301 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.327475 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.327607 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.327789 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.327917 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.328103 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.328239 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.328425 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.328517 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.328747 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.328839 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.329055 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.329158 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.329383 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.329473 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.329700 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.329790 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.330013 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.330109 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.330325 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.330427 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.330649 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.330762 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.330974 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.331114 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.331283 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.331402 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.331587 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.331678 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.331888 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.331978 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.332193 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.332297 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.332448 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.332538 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.332759 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.332849 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.333081 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.333247 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.333479 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.333642 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.333803 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.333908 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.334049 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.334180 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.334304 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.334440 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.334638 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.334766 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.335455 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.335596 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.335723 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.335855 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.335971 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.336086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.336194 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.336321 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.336429 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.336560 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.336685 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.336809 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.336932 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.337069 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.337205 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.337340 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.337479 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.337603 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.337735 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.337872 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.338005 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.338138 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.338270 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.338395 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.338532 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.338702 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.338828 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.338951 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.339210 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.339356 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.339485 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.339624 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.339894 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.340021 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.340144 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.340268 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.340403 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.340540 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.340679 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.340936 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.341071 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.341209 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.341474 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.341566 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.341659 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.341751 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.341840 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.341931 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.342119 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.342210 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.342423 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.342527 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.342786 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.342879 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.343088 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.343179 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.343381 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.343480 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.343687 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.343820 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.343996 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.344124 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.344320 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.344432 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.344628 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.344719 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.344938 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.345028 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.345243 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.345341 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.345545 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.345676 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.345852 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.345943 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.346160 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.346258 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.346475 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.346584 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.346806 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.346894 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.347123 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.347213 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.347428 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.347517 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.347734 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.347834 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.348042 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.348141 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.348347 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.348444 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.348649 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.348773 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.348993 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.349086 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.349312 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.349409 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.349621 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.349721 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.349929 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.350027 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.350241 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.350346 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.350547 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.350728 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.350883 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.350973 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.351190 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.351282 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.351497 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.351635 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.351801 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.351899 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.352109 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.352200 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.352413 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.352500 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.352718 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.352807 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.353032 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.353172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.353339 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.353467 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.353655 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.353750 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.353960 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.354051 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.354284 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.354382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.354579 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.354685 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.354897 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.354987 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.355214 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.355302 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.355520 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.355624 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.355827 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.355917 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.356136 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.356232 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.356456 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.356556 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.356764 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.356978 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.357070 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.357365 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.357529 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.357668 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.357968 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.358099 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.358274 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.358374 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.358598 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.358725 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.358915 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.359041 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.359221 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.359357 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.359523 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.359670 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.359837 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.359997 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 11:59:09.360141 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.360341 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.360446 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.360677 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.360767 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.361023 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.361112 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.361339 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.361436 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.361649 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.361740 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.361967 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.362059 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.362288 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.362378 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.362608 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.362715 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.362912 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.363003 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.363232 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.363365 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.363541 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.363639 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.363843 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.363932 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.364145 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.364244 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.364516 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.364608 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.364839 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.364930 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.365172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.365324 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.365492 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.365594 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.365805 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.365906 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.366123 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.366213 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.366430 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.366521 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.366769 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.366874 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.367076 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.367165 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.367383 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.367471 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.367806 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.367928 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.368060 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.368156 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.368306 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.368394 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.368615 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.368705 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.368926 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.369014 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.369234 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.369321 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.369542 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.369669 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.369863 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.370001 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.370170 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.370260 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.370479 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.370644 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.370814 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.370896 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.371119 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.371249 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.375323 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.375492 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.375652 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.375796 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.375796 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.376055 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.376194 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.376285 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.376369 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.376452 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.376542 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.376636 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.376720 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.376804 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.376944 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.377083 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.377181 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.377267 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.377356 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.377447 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.377538 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.377630 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.377723 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.377806 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.377894 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.377966 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.378134 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.378231 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.378314 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.378402 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.378485 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.378582 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.378685 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.378770 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.378851 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.378942 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.379080 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.379168 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.379265 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.379348 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.379437 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.379520 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.379600 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.379682 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.379772 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.379901 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.380056 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.380185 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.380320 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.380414 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.380510 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.380600 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.380692 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.380825 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.381272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.381419 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.381546 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.381632 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.381765 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.381765 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.381973 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.382067 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.382159 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.382285 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.382417 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.382511 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.382611 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.382710 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.382806 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.382889 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.382970 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.383050 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.383137 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.383229 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.383319 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.383402 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.383482 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.383570 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.383712 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.383799 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.383887 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.384057 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.384193 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.384373 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.384525 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.384697 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.384845 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.384986 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.385096 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.385337 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.385493 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.385657 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.385793 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.385960 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.386106 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.386287 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.386376 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.386606 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.386758 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.386851 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.387341 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.387458 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.387546 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.387636 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.387723 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.387805 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.387888 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.388054 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.388190 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.388328 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.388439 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.388659 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.388806 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.388910 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.389029 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.389246 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.389383 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.389561 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.389711 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.389813 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.389909 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.390144 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.390316 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.390451 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.390577 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.390824 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.390929 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.391145 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.391234 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.391443 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.391549 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.391745 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.391847 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.392046 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.392139 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.392346 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.392445 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.392650 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.392744 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.392952 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.393046 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.393283 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.393386 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.393575 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.393668 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.393880 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.393976 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.394179 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.394273 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.394486 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.394613 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.394811 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.394913 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.395115 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.395209 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.395422 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.395522 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.395767 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.395868 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.396086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.396187 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.396387 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.396480 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.396699 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.396801 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.397011 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.397129 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.397290 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.397387 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.397592 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.397690 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.397898 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.397986 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.398201 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.398281 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.398501 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.398614 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.398827 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.398920 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.399130 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.399210 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.399431 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.399529 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.399753 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.399840 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.400061 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.400162 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.400365 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.400454 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.400668 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.400791 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.400974 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.401075 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.401315 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.401402 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.401616 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.401717 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.401928 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.402025 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.402241 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.402332 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.402641 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.402749 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.402898 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.402987 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.403209 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.403295 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.403518 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.403595 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.404177 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.404281 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.404483 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.404581 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.404798 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.404895 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.405102 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.405206 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.405417 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.405527 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.405703 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.405829 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.406006 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.406156 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.406326 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.406418 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.406660 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.406765 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.406974 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.407079 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.407295 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.407384 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.407608 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.407697 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.407923 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.408021 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.408224 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.408313 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.408530 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.408619 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.408839 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.408928 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.409150 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.409246 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.409460 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.409557 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.409770 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.409859 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.410078 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.410166 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.410396 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.410604 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.410785 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.411283 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.411418 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.411418 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.411574 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.411664 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.411759 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.411990 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.412081 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.412305 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.412402 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.412634 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.412725 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.412947 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.413035 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.413254 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.413341 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.413561 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.413655 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.413868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.413956 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.414179 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.414268 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.414487 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.414599 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.414824 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.414915 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.415131 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.415227 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.415474 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.415573 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.415791 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.415884 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.416098 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.416201 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.416424 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.416514 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.416747 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.416836 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.417057 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.417160 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.417375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.417466 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.417685 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.417781 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.417988 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.418086 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.418308 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.418405 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.418652 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.418776 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.418968 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.419114 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.419283 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.419374 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.419598 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.419687 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.419902 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.419999 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.420223 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.420319 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.420545 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.420641 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.420938 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.421185 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.421306 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.421405 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.421498 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.421596 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.421743 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.421842 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.422047 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.422145 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.422364 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.422462 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.422803 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.422981 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.423118 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.423322 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.423413 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.423689 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.423827 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.424012 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.424140 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.424366 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.424509 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.424689 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.424792 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.425022 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.425121 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.425354 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.425453 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.425660 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.425747 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.425967 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.426065 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.426272 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.426362 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.426606 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.426700 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.426942 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.427036 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.427256 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.427343 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.427563 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.427660 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.427866 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.427965 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.428173 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.428297 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.428485 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.428618 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.428803 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.429082 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.429229 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.429395 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.429521 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.429705 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.429845 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.430016 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.430156 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.430339 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.430478 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.430679 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.430831 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.431003 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.431202 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.431397 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.431557 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.431722 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.431833 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.432192 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.432304 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.432391 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.432483 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.432581 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.432667 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.432808 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.433783 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.434689 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.434802 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.434900 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.434980 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.435054 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.435138 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.435220 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.435382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.435468 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.435549 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.435622 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.435706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.435796 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.435883 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.435960 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.435960 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.436101 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.436174 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.436245 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.436328 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.436415 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.436538 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.436651 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.436904 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.437228 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.437353 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.437538 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.437635 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.437845 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.437999 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.438151 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.438243 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.438456 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.438547 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.439017 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.439103 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.439201 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.439297 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.439381 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.439535 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.439691 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.439866 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.440015 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.440196 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.440332 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.440507 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.440641 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.440838 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.440938 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.441172 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.441311 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.441493 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.441584 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.441805 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.441906 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.442122 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.442214 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.442431 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.442617 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.442817 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.442944 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.443121 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.443221 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.443427 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.443516 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.443730 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.443819 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.444033 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.444161 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.444336 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.444427 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.444642 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.444734 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.444944 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.445040 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.445246 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.445346 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.445548 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.445639 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.445852 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.445942 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.446159 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.446263 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.446466 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.446585 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.446795 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.446896 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.447099 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.447202 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.447402 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.447492 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.447703 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.447805 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.448024 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.448120 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.448336 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.448423 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.448642 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.448734 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.448955 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.449045 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.449263 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.449352 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.449575 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.449700 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.449882 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.449981 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.450190 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.450296 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.450496 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.450620 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.450833 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.450931 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.451139 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.451228 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.451452 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.451552 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.451758 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.451853 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.452065 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.452154 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.452373 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.452465 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.452680 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.452769 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.453026 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.453242 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.453345 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.453579 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.453688 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.453897 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.453988 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.454213 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.454347 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.454527 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.454699 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.454866 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.454959 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.455180 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.455272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.455492 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.455584 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.455805 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.455896 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.456116 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.456215 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.456425 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.456515 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.456741 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.456831 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.457050 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.457148 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.457361 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.457452 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.457688 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.457787 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.458005 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.458146 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.458342 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.458432 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.458680 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.458797 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.458997 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.459131 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.459322 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.459412 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.459632 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.459748 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.459943 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.460036 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.460257 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.460354 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.460570 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.460667 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.460885 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.460983 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.461195 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.461292 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.461505 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.461620 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.461816 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.461914 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.462128 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.462218 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.462440 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.462531 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.462778 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.462901 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.463088 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.463213 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.463398 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.463488 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.463713 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.463806 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.464024 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.464128 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.464345 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.464467 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.464657 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.464756 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.464963 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.465065 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.465273 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.465363 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.465582 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.465792 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.465891 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.466109 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.466209 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.466440 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.466666 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.466777 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.466990 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.467102 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.467308 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.467426 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.467619 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.467743 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.467938 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.468079 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.468260 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.468382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.468583 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.468672 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.468904 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.469001 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.469214 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.469304 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.469557 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.469646 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.469877 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.469968 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.470186 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.470276 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.470490 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.470667 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.470832 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.470923 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.471143 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.471241 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.471469 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.471674 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.471795 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.472022 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.472110 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.472336 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.472428 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.472660 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.472756 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.472978 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.473080 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.473293 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.473401 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.473597 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.473702 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.474000 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.474105 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.474307 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.474406 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.474634 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.474718 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.474948 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.475129 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.475259 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.475446 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.475563 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.475763 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.475852 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.476089 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.476179 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.476420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.476511 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.476744 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.476832 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.477053 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.477161 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.477350 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.477438 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.477672 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.477770 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.477972 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.478073 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.478274 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.478404 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.478631 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.478739 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.478903 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.479007 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.479209 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.479336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.479513 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.479610 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.479815 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.479915 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.480117 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.480209 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.480427 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.480516 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.480727 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.480902 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.481135 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.481240 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.481437 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.481535 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.481746 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.481870 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.482103 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.482196 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.482412 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.482511 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.482742 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.482835 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.483070 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.483161 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.483372 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.483461 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.483672 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.483773 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.483987 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.484086 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.484294 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.484398 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.484610 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.484699 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.484919 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.485000 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.485227 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.485385 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.485536 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.485624 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.485846 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.485943 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.486179 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.486381 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.486486 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.486740 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.486833 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.487062 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.487153 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.487396 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.487495 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.487725 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.487815 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.488029 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.488131 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.488332 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.488422 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.488634 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.488726 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.488958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.489064 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.489266 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.489374 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.489599 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.489699 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.489905 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.490004 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.490212 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.490309 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.490516 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.490627 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.490850 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.490958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.491157 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.491258 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.491462 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.491560 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.491770 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.491872 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.492076 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.492201 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.492385 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.492477 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.492692 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.492803 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.492999 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.493090 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.493306 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.493404 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.493620 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.493719 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.493958 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.494056 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.494277 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.494376 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.494606 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.494699 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.494921 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.495014 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.495232 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.495373 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.495538 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.495628 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.495844 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.495949 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.496149 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.496248 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.496452 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.496543 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.496768 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.496857 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.497073 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.497177 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.497387 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.497476 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.497691 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.497781 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.497996 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.498094 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.498306 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.498404 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.498637 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.498732 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.498988 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.499092 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.499298 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.499398 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.499632 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.499722 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.499949 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.500048 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.500256 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.500348 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.500573 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.500672 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.500885 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.500983 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.501203 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.501301 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.501524 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.501623 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.501843 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.501942 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.502163 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.502254 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.502462 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.502580 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.502789 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.502881 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.503089 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.503179 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.503395 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.503502 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.503708 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.503801 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.504020 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.504276 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.504402 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.504606 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.504711 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.504911 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.505050 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.505258 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.505360 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.505558 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.505651 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.505856 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.505947 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.506155 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.506259 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.506459 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.506606 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.506781 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.506872 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.507080 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.507185 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.507379 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.507506 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.507676 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.507776 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.507974 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.508065 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.508270 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.508369 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.508574 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.508706 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.508873 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.509028 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.509174 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.509346 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.509473 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.509664 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.509821 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.509982 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.510099 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.510345 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.510448 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.510690 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.510785 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.511004 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.511105 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.511323 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.511421 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.511632 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.511730 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.511946 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.512035 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.512252 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.512358 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.512566 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.512666 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.512885 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.512979 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.513197 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.513301 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.513511 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.513609 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.513820 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.513912 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.514136 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.514355 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.514471 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.514621 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.514780 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.514880 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.515091 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.515191 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.515399 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.515490 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.515706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.515804 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.516037 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.516135 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.516357 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.516452 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.516656 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.516887 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.516987 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.517208 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.517306 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.517548 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.517647 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.517881 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.517987 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.518187 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.518282 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.518514 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.518653 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.518843 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.518936 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.519151 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.519241 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.519458 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.519556 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.519769 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.519851 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.520076 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.520181 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.520387 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.520476 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.520717 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.520818 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.521032 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.521131 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.521343 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.521440 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.521654 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.521746 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.521974 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.522063 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.522284 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.522420 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.522606 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.522866 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.522971 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.523225 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.523323 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.523548 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.523648 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.523866 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.523956 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.524193 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.524283 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.524514 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.524613 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.524822 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.524921 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.525133 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.525237 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.525433 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.525565 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.525665 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118995) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 11 11:59:09.525785 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.526052 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.526369 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.526704 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.527015 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.527331 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.527645 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.527952 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.528268 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.528573 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.529220 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.529527 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.529835 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.530144 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.530460 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.530804 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.531113 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.531420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.531727 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.532050 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.532349 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.532760 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.533075 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.533392 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.533756 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.534068 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.534377 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.534731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.535043 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.535351 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.535671 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.535985 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.536360 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.536677 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.536994 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.537344 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.537664 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.538207 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.538564 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.538898 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.539241 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.539582 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.539893 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.540202 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.540511 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.540839 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.541153 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.541471 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.541787 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.542101 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.542413 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.542757 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.543072 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.543384 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.543700 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.544015 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.544334 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.544651 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.544965 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.545280 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.545597 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.545945 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.546276 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.546626 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.546951 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.547274 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.547613 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.547979 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.548270 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.548626 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.548970 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.549338 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.549686 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.550034 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.550491 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.550846 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.551195 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.551561 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.551964 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.552293 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.552642 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.552984 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.553344 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.553675 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.554043 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.554451 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.554822 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.555190 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.555560 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.555900 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.556314 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.556544 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.556867 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.557183 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.557491 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.557798 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.558111 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.558418 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.558754 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.559062 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.559366 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.559676 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.559983 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.560290 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.560596 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.560902 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.561205 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.561508 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.561817 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.562124 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.562432 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.562775 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.563084 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.563388 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.563724 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.564061 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.564382 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.564712 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.565028 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.565353 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.565664 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.565995 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.566321 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.566671 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.566986 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.567321 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.567686 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.568003 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.568322 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.568637 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.568952 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.569265 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.569597 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.569931 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.570240 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.570575 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.570914 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.571237 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.571559 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.571876 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.572209 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.572523 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.572839 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.573152 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.573468 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.573784 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.574104 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.574419 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.574759 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.575081 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.575402 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.575735 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.576066 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.576382 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.576709 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.577038 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.577387 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.577704 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.578049 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.578382 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.578851 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.579169 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.579479 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 11:59:09.579726 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 11 11:59:09.587718 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO dbcounter [None req-5042dbaf-025a-4b24-9209-6098a544df97 None None] Registered counter for database nova_api Oct 11 11:59:09.608608 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_db.sqlalchemy.engines [None req-5042dbaf-025a-4b24-9209-6098a544df97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118995) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 11:59:09.615775 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writer thread running {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 11:59:09.641737 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO dbcounter [None req-56f5dec6-759e-41a7-9619-671211064347 None None] Registered counter for database nova_api Oct 11 11:59:09.663564 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_db.sqlalchemy.engines [None req-56f5dec6-759e-41a7-9619-671211064347 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118994) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 11:59:09.671452 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writer thread running {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 11:59:09.671671 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.context [None req-5042dbaf-025a-4b24-9209-6098a544df97 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e492fd93-7bd3-42bb-9bb9-d80ad3eb5733(cell1) {{(pid=118995) load_cells /opt/stack/nova/nova/context.py:464}} Oct 11 11:59:09.675550 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5042dbaf-025a-4b24-9209-6098a544df97 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 11:59:09.676019 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5042dbaf-025a-4b24-9209-6098a544df97 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 11:59:09.677685 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5042dbaf-025a-4b24-9209-6098a544df97 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 11:59:09.678415 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5042dbaf-025a-4b24-9209-6098a544df97 None None] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 11:59:09.678872 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5042dbaf-025a-4b24-9209-6098a544df97 None None] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 11:59:09.680863 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5042dbaf-025a-4b24-9209-6098a544df97 None None] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 11:59:09.682879 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO dbcounter [None req-5042dbaf-025a-4b24-9209-6098a544df97 None None] Registered counter for database nova_cell0 Oct 11 11:59:09.686916 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO dbcounter [None req-5042dbaf-025a-4b24-9209-6098a544df97 None None] Registered counter for database nova_cell1 Oct 11 11:59:09.694603 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_db.sqlalchemy.engines [None req-5042dbaf-025a-4b24-9209-6098a544df97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118995) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 11:59:09.696928 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_db.sqlalchemy.engines [None req-5042dbaf-025a-4b24-9209-6098a544df97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118995) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 11:59:09.702803 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writer thread running {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 11:59:09.704064 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writer thread running {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 11:59:09.727572 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.context [None req-56f5dec6-759e-41a7-9619-671211064347 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e492fd93-7bd3-42bb-9bb9-d80ad3eb5733(cell1) {{(pid=118994) load_cells /opt/stack/nova/nova/context.py:464}} Oct 11 11:59:09.731816 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-56f5dec6-759e-41a7-9619-671211064347 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 11:59:09.732303 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-56f5dec6-759e-41a7-9619-671211064347 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 11:59:09.733951 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-56f5dec6-759e-41a7-9619-671211064347 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 11:59:09.734743 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-56f5dec6-759e-41a7-9619-671211064347 None None] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 11:59:09.735211 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-56f5dec6-759e-41a7-9619-671211064347 None None] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 11:59:09.737321 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-56f5dec6-759e-41a7-9619-671211064347 None None] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 11:59:09.739586 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO dbcounter [None req-56f5dec6-759e-41a7-9619-671211064347 None None] Registered counter for database nova_cell0 Oct 11 11:59:09.743903 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO dbcounter [None req-56f5dec6-759e-41a7-9619-671211064347 None None] Registered counter for database nova_cell1 Oct 11 11:59:09.751261 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_db.sqlalchemy.engines [None req-56f5dec6-759e-41a7-9619-671211064347 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118994) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 11:59:09.753215 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_db.sqlalchemy.engines [None req-56f5dec6-759e-41a7-9619-671211064347 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118994) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 11:59:09.759174 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writer thread running {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 11:59:09.764809 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writer thread running {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 11:59:09.847863 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO dbcounter [None req-5042dbaf-025a-4b24-9209-6098a544df97 None None] Registered counter for database nova_cell0 Oct 11 11:59:09.855189 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_db.sqlalchemy.engines [None req-5042dbaf-025a-4b24-9209-6098a544df97 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118995) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 11:59:09.860082 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writer thread running {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 11:59:09.913316 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO dbcounter [None req-56f5dec6-759e-41a7-9619-671211064347 None None] Registered counter for database nova_cell0 Oct 11 11:59:09.920905 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_db.sqlalchemy.engines [None req-56f5dec6-759e-41a7-9619-671211064347 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118994) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 11:59:09.926186 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writer thread running {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 11:59:10.175462 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: WARNING keystonemiddleware.auth_token [None req-5042dbaf-025a-4b24-9209-6098a544df97 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 11:59:10.182839 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: WARNING keystonemiddleware.auth_token [None req-5042dbaf-025a-4b24-9209-6098a544df97 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 11:59:10.252305 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: WARNING keystonemiddleware.auth_token [None req-56f5dec6-759e-41a7-9619-671211064347 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 11:59:10.259945 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: WARNING keystonemiddleware.auth_token [None req-56f5dec6-759e-41a7-9619-671211064347 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 11:59:10.532929 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: WARNING keystonemiddleware.auth_token [None req-5042dbaf-025a-4b24-9209-6098a544df97 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 11:59:10.539241 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: WARNING keystonemiddleware.auth_token [None req-5042dbaf-025a-4b24-9209-6098a544df97 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 11:59:10.544805 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5618e643d9c0 pid: 118995 (default app) Oct 11 11:59:10.612297 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: WARNING keystonemiddleware.auth_token [None req-56f5dec6-759e-41a7-9619-671211064347 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 11:59:10.618846 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: WARNING keystonemiddleware.auth_token [None req-56f5dec6-759e-41a7-9619-671211064347 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 11:59:10.624420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5618e643d9c0 pid: 118994 (default app) Oct 11 11:59:45.575756 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=3 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:59:45.576617 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=3 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:59:45.577669 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=3 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:59:45.578095 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=3 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:59:46.519271 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-fa35a148-3dba-44ee-80e3-46e50a6d80d7 tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] Action: 'create', calling method: .version_select at 0x7fd4076df4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-2110898693"}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 11:59:48.900410 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-fa35a148-3dba-44ee-80e3-46e50a6d80d7 tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.337028 Oct 11 11:59:48.901475 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 1/1] 10.222.0.59 () {60 vars in 1155 bytes} [Tue Oct 11 11:59:45 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3340 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 11 11:59:49.524533 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-899cdd35-d736-4fa7-97bf-9be2878e9608 tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] Calling method '.version_select at 0x7fd40776c0d0>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:59:49.602919 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_api:SELECT=3 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:59:49.603866 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell0:SELECT=3 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:59:49.604847 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=3 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:59:49.613421 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell0:SELECT=3 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 11:59:51.203440 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-899cdd35-d736-4fa7-97bf-9be2878e9608 tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/ad3d7563-2012-4051-bf39-aa57137b407b" status: 200 len: 346 microversion: 2.1 time: 2.285455 Oct 11 11:59:51.205486 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 1/2] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Oct 11 11:59:48 2022] GET /compute/v2.1/os-volumes/ad3d7563-2012-4051-bf39-aa57137b407b => generated 346 bytes in 2291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 11:59:51.220919 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b7075ffc-48fe-47b8-a5f1-4c553adbed75 tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] Action: 'create', calling method: .version_select at 0x7fd4075b4310>, body: {"snapshot": {"volume_id": "ad3d7563-2012-4051-bf39-aa57137b407b", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1086277159"}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 11:59:51.723041 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b7075ffc-48fe-47b8-a5f1-4c553adbed75 tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] 10.222.0.59 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.506918 Oct 11 11:59:51.730096 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 2/3] 10.222.0.59 () {60 vars in 1162 bytes} [Tue Oct 11 11:59:51 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 11:59:51.740775 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-b194e4c5-741c-4b91-85ec-fb1ba97c4ed0 tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] Calling method '.version_select at 0x7fd40758b430>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:59:51.851245 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-b194e4c5-741c-4b91-85ec-fb1ba97c4ed0 tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c" status: 200 len: 287 microversion: 2.1 time: 0.118375 Oct 11 11:59:51.862297 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 2/4] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Oct 11 11:59:51 2022] GET /compute/v2.1/os-snapshots/ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c => generated 287 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 11:59:51.874617 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0d5eebd8-3f4c-42fa-9523-f69e2da5df93 tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] Calling method '.version_select at 0x7fd4075495e0>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:59:52.426467 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0d5eebd8-3f4c-42fa-9523-f69e2da5df93 tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.559037 Oct 11 11:59:52.434266 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 3/5] 10.222.0.59 () {58 vars in 1140 bytes} [Tue Oct 11 11:59:51 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 11:59:52.446817 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-76703048-0474-4b03-b2f3-35ee8b03a6e4 tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] Calling method '.version_select at 0x7fd40758b4c0>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:59:52.531736 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-76703048-0474-4b03-b2f3-35ee8b03a6e4 tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c" status: 200 len: 287 microversion: 2.1 time: 0.095175 Oct 11 11:59:52.533212 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 3/6] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Oct 11 11:59:52 2022] GET /compute/v2.1/os-snapshots/ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c => generated 287 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 11:59:53.554796 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-22a1ccab-4a15-4659-832f-ba46bf337e2b tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] Calling method '.version_select at 0x7fd407549c10>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:59:53.701457 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-22a1ccab-4a15-4659-832f-ba46bf337e2b tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c" status: 200 len: 287 microversion: 2.1 time: 0.152039 Oct 11 11:59:53.702153 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 4/7] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Oct 11 11:59:53 2022] GET /compute/v2.1/os-snapshots/ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c => generated 287 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 11:59:54.741120 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-b47f10e1-ef5e-44f6-92d5-d809aa9f22da tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] Calling method '.version_select at 0x7fd40758bc10>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:59:54.826662 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-b47f10e1-ef5e-44f6-92d5-d809aa9f22da tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c" status: 200 len: 287 microversion: 2.1 time: 0.110480 Oct 11 11:59:54.827473 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 4/8] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Oct 11 11:59:54 2022] GET /compute/v2.1/os-snapshots/ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c => generated 287 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 11:59:55.844192 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e75dd547-dce7-4fbb-99ef-c8518a9e3301 tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] Calling method '.version_select at 0x7fd407549310>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:59:56.339936 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e75dd547-dce7-4fbb-99ef-c8518a9e3301 tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c" status: 200 len: 287 microversion: 2.1 time: 0.502783 Oct 11 11:59:56.341673 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 5/9] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Oct 11 11:59:55 2022] GET /compute/v2.1/os-snapshots/ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c => generated 287 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 11:59:57.358474 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-3d427ba4-6b1f-4c89-93e8-17b8f27ef3aa tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] Calling method '.version_select at 0x7fd4075b2310>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:59:57.493666 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-3d427ba4-6b1f-4c89-93e8-17b8f27ef3aa tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c" status: 200 len: 287 microversion: 2.1 time: 0.142355 Oct 11 11:59:57.495489 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 5/10] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Oct 11 11:59:57 2022] GET /compute/v2.1/os-snapshots/ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c => generated 287 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 11:59:58.516796 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8793d3d3-75e4-4c45-8414-de8e564d4826 tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] Calling method '.version_select at 0x7fd4075b4c10>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:59:58.619823 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8793d3d3-75e4-4c45-8414-de8e564d4826 tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c" status: 200 len: 288 microversion: 2.1 time: 0.113677 Oct 11 11:59:58.627393 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 6/11] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Oct 11 11:59:58 2022] GET /compute/v2.1/os-snapshots/ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c => generated 288 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 11:59:58.632752 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-f1ac7c79-0b51-4956-ac8b-94a636cd406f tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] Calling method '.version_select at 0x7fd40758bca0>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:59:58.901579 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-f1ac7c79-0b51-4956-ac8b-94a636cd406f tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] 10.222.0.59 "DELETE /compute/v2.1/os-snapshots/ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c" status: 202 len: 0 microversion: 2.1 time: 0.272664 Oct 11 11:59:58.906117 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 6/12] 10.222.0.59 () {58 vars in 1254 bytes} [Tue Oct 11 11:59:58 2022] DELETE /compute/v2.1/os-snapshots/ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 11:59:58.911578 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2b4a727b-51ae-42e2-bd00-d9c6aaa1845d tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] Calling method '.version_select at 0x7fd407549430>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 11:59:59.012308 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2b4a727b-51ae-42e2-bd00-d9c6aaa1845d tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c" status: 200 len: 287 microversion: 2.1 time: 0.104859 Oct 11 11:59:59.013291 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 7/13] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Oct 11 11:59:58 2022] GET /compute/v2.1/os-snapshots/ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c => generated 287 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 12:00:00.030308 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-b037c9f9-d529-40b8-acc4-2569f1343341 tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] Calling method '.version_select at 0x7fd40758b3a0>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:00.122624 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-b037c9f9-d529-40b8-acc4-2569f1343341 tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c" status: 200 len: 287 microversion: 2.1 time: 0.099436 Oct 11 12:00:00.122624 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 7/14] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Oct 11 12:00:00 2022] GET /compute/v2.1/os-snapshots/ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c => generated 287 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:00:01.139714 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f039eec6-80f6-44f9-8523-1bd8d2d6f9a1 tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] Calling method '.version_select at 0x7fd407549b80>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:01.332769 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f039eec6-80f6-44f9-8523-1bd8d2d6f9a1 tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c" status: 200 len: 287 microversion: 2.1 time: 0.199244 Oct 11 12:00:01.334069 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 8/15] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Oct 11 12:00:01 2022] GET /compute/v2.1/os-snapshots/ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c => generated 287 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:00:02.357052 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-4f40aa4f-af4d-417c-b26d-9c1b8a74d0e0 tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] Calling method '.version_select at 0x7fd4075b2670>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:02.517119 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-4f40aa4f-af4d-417c-b26d-9c1b8a74d0e0 tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c" status: 200 len: 287 microversion: 2.1 time: 0.169527 Oct 11 12:00:02.526836 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 8/16] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Oct 11 12:00:02 2022] GET /compute/v2.1/os-snapshots/ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c => generated 287 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:00:03.539036 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0b463db4-37ed-41da-9169-ea6439c8fffa tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] Calling method '.version_select at 0x7fd4075b4a60>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:03.921356 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-7753e770-c362-40c0-8a64-a000c70aa2bc tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Action: 'create', calling method: .version_select at 0x7fd40758b790>, body: {"keypair": {"name": "tempest-keypair-1946892434", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkF+JCkt2SJTtcYn4s/D22IvXCjomrGbcGNWqAeKqsEjNHuSmHRmjHIh7vAJGTO3lztIty2XfiImNzwcO7mMmmapwwLWuBDfVZlCvWfPzpRFEI29rsv8Xo+mktp7Q7m0Q=="}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:00:03.946722 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-0b463db4-37ed-41da-9169-ea6439c8fffa tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] HTTP exception thrown: Snapshot ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c could not be found. Oct 11 12:00:03.954280 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0b463db4-37ed-41da-9169-ea6439c8fffa tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] Request method failure captured: Oct 11 12:00:03.954280 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/os-snapshots/ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c HTTP/1.1 Oct 11 12:00:03.954280 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 11 12:00:03.954280 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 11 12:00:03.954280 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Connection: close Oct 11 12:00:03.954280 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 11 12:00:03.954280 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 11 12:00:03.954280 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Host: 10.222.0.59 Oct 11 12:00:03.954280 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 11 12:00:03.954280 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 11 12:00:03.954280 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjRVqxJLhyvfadZHRlqauKgRf_uzhORlwM4Ypy1QhfuoPK7yp4bFZ6vKvLxLSfp-eYjvjdL234L5lZis9xVdkAbTmdYCmHEDknp9hOc69El2DvlP8ZPrimOfcURr6_M_m8eVj7_h7g_JKIl2v0NyCGIWHs-WTX8edLlpu9f13O2S4T9AM Oct 11 12:00:03.954280 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 11 12:00:03.954280 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 11 12:00:03.954280 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 11 12:00:03.954280 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 11 12:00:03.954280 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 11 12:00:03.954280 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 11 12:00:03.954280 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Id: 81ed94c4abf74746bb798c6cf80173ca Oct 11 12:00:03.954280 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1117192870 Oct 11 12:00:03.954280 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Role: reader,member Oct 11 12:00:03.954280 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Roles: reader,member Oct 11 12:00:03.955946 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/81ed94c4abf74746bb798c6cf80173ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_81ed94c4abf74746bb798c6cf80173ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/81ed94c4abf74746bb798c6cf80173ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/81ed94c4abf74746bb798c6cf80173ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:00:03.955946 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1117192870 Oct 11 12:00:03.955946 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 81ed94c4abf74746bb798c6cf80173ca Oct 11 12:00:03.955946 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1117192870 Oct 11 12:00:03.955946 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User: tempest-VolumesSnapshotsTestJSON-1117192870-project Oct 11 12:00:03.955946 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 11 12:00:03.955946 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 11 12:00:03.955946 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Id: 443b625c635944189820425cea6c5722 Oct 11 12:00:03.955946 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1117192870-project Oct 11 12:00:03.955946 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: method: Oct 11 12:00:03.955946 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: exception: Snapshot ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c could not be found. Oct 11 12:00:03.955946 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: action_args: {'id': 'ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c'} Oct 11 12:00:03.955946 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:00:03.956798 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:00:03.956798 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 11 12:00:03.956798 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 11 12:00:03.956798 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 11 12:00:03.956798 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 11 12:00:03.956798 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 11 12:00:03.956798 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 11 12:00:03.956798 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 12:00:03.956798 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 12:00:03.956798 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 12:00:03.956798 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 12:00:03.956798 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 12:00:03.956798 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 12:00:03.956798 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 12:00:03.956798 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 12:00:03.956798 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c could not be found. (HTTP 404) (Request-ID: req-2e809506-9ccd-48b2-9b52-8347901a8136) Oct 11 12:00:03.956798 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:00:03.956798 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:00:03.960546 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:00:03.960546 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:00:03.960546 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 11 12:00:03.960546 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 11 12:00:03.960546 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 12:00:03.960546 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 12:00:03.960546 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 11 12:00:03.960546 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 11 12:00:03.960546 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 12:00:03.960546 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 12:00:03.960546 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 11 12:00:03.960546 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 11 12:00:03.960546 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 11 12:00:03.960546 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 11 12:00:03.960546 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 11 12:00:03.960546 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 11 12:00:03.960546 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 12:00:03.960546 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 12:00:03.960546 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 12:00:03.963575 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 12:00:03.963575 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 12:00:03.963575 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 12:00:03.963575 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 12:00:03.963575 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 12:00:03.963575 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c could not be found. Oct 11 12:00:03.963575 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:00:03.963575 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:00:03.963575 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:00:03.963575 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:00:03.963575 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:00:03.963575 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:00:03.963575 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:00:03.963575 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:00:03.963575 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 12:00:03.963575 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 12:00:03.963575 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:00:03.963575 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:00:03.963575 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 11 12:00:03.963575 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:00:03.967375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c could not be found. Oct 11 12:00:03.967375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:00:03.967375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:00:03.967375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:00:03.967375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:00:03.967375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:00:03.967375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:00:03.967375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:00:03.967375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:00:03.967375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c could not be found. Oct 11 12:00:03.967375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:00:03.973413 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0b463db4-37ed-41da-9169-ea6439c8fffa tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] Returning 404 to user: Snapshot ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:00:03.975301 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0b463db4-37ed-41da-9169-ea6439c8fffa tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c" status: 404 len: 111 microversion: 2.1 time: 0.443472 Oct 11 12:00:03.976300 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 9/17] 10.222.0.59 () {58 vars in 1251 bytes} [Tue Oct 11 12:00:03 2022] GET /compute/v2.1/os-snapshots/ae1bf2ae-ba4e-4111-a99f-d42f77db9e5c => generated 111 bytes in 446 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:00:04.013907 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a70d8ca8-2e3a-4c7e-9708-39ae27cc858f tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] Calling method '.version_select at 0x7fd4075b45e0>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:04.098041 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-7753e770-c362-40c0-8a64-a000c70aa2bc tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Getting quotas for project c83f971a0ae04288a5c6dc87d3370979. Resources: {'key_pairs'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 12:00:04.155137 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-7753e770-c362-40c0-8a64-a000c70aa2bc tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Getting quotas for user 41d3680dda7c4cc8aeb6d086efca0775 and project c83f971a0ae04288a5c6dc87d3370979. Resources: {'key_pairs'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 12:00:04.225624 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a70d8ca8-2e3a-4c7e-9708-39ae27cc858f tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/ad3d7563-2012-4051-bf39-aa57137b407b" status: 202 len: 0 microversion: 2.1 time: 0.230890 Oct 11 12:00:04.226727 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 10/18] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Oct 11 12:00:03 2022] DELETE /compute/v2.1/os-volumes/ad3d7563-2012-4051-bf39-aa57137b407b => generated 0 bytes in 238 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 12:00:04.278497 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-472d0d50-507a-40ba-8ea1-b094d8711d07 tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] Calling method '.version_select at 0x7fd407531430>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:04.447809 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-472d0d50-507a-40ba-8ea1-b094d8711d07 tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/ad3d7563-2012-4051-bf39-aa57137b407b" status: 200 len: 345 microversion: 2.1 time: 0.216909 Oct 11 12:00:04.455850 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 11/19] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Oct 11 12:00:04 2022] GET /compute/v2.1/os-volumes/ad3d7563-2012-4051-bf39-aa57137b407b => generated 345 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 12:00:04.465233 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-7753e770-c362-40c0-8a64-a000c70aa2bc tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.855665 Oct 11 12:00:04.480614 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 9/20] 10.222.0.59 () {60 vars in 1159 bytes} [Tue Oct 11 12:00:03 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:00:05.472757 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-60a8c1a0-47ed-4dac-b679-6b615afb6fae tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] Calling method '.version_select at 0x7fd4075b45e0>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:05.631128 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-60a8c1a0-47ed-4dac-b679-6b615afb6fae tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] HTTP exception thrown: Volume ad3d7563-2012-4051-bf39-aa57137b407b could not be found. Oct 11 12:00:05.633367 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-60a8c1a0-47ed-4dac-b679-6b615afb6fae tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] Request method failure captured: Oct 11 12:00:05.633367 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/os-volumes/ad3d7563-2012-4051-bf39-aa57137b407b HTTP/1.1 Oct 11 12:00:05.633367 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 11 12:00:05.633367 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 11 12:00:05.633367 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Connection: close Oct 11 12:00:05.633367 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 11 12:00:05.633367 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 11 12:00:05.633367 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Host: 10.222.0.59 Oct 11 12:00:05.633367 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 11 12:00:05.633367 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 11 12:00:05.633367 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjRVqxJLhyvfadZHRlqauKgRf_uzhORlwM4Ypy1QhfuoPK7yp4bFZ6vKvLxLSfp-eYjvjdL234L5lZis9xVdkAbTmdYCmHEDknp9hOc69El2DvlP8ZPrimOfcURr6_M_m8eVj7_h7g_JKIl2v0NyCGIWHs-WTX8edLlpu9f13O2S4T9AM Oct 11 12:00:05.633367 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 11 12:00:05.633367 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 11 12:00:05.633367 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 11 12:00:05.633367 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 11 12:00:05.633367 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 11 12:00:05.633367 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 11 12:00:05.633367 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Id: 81ed94c4abf74746bb798c6cf80173ca Oct 11 12:00:05.633367 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1117192870 Oct 11 12:00:05.633367 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Role: reader,member Oct 11 12:00:05.633367 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Roles: reader,member Oct 11 12:00:05.634908 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/81ed94c4abf74746bb798c6cf80173ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_81ed94c4abf74746bb798c6cf80173ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/81ed94c4abf74746bb798c6cf80173ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/81ed94c4abf74746bb798c6cf80173ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:00:05.634908 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1117192870 Oct 11 12:00:05.634908 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 81ed94c4abf74746bb798c6cf80173ca Oct 11 12:00:05.634908 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1117192870 Oct 11 12:00:05.634908 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User: tempest-VolumesSnapshotsTestJSON-1117192870-project Oct 11 12:00:05.634908 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 11 12:00:05.634908 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 11 12:00:05.634908 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Id: 443b625c635944189820425cea6c5722 Oct 11 12:00:05.634908 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1117192870-project Oct 11 12:00:05.634908 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: method: Oct 11 12:00:05.634908 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: exception: Volume ad3d7563-2012-4051-bf39-aa57137b407b could not be found. Oct 11 12:00:05.634908 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: action_args: {'id': 'ad3d7563-2012-4051-bf39-aa57137b407b'} Oct 11 12:00:05.634908 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:00:05.635893 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:00:05.635893 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 12:00:05.635893 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 12:00:05.635893 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 12:00:05.635893 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 12:00:05.635893 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 12:00:05.635893 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 12:00:05.635893 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 12:00:05.635893 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 12:00:05.635893 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 12:00:05.635893 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 12:00:05.635893 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 12:00:05.635893 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 12:00:05.635893 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 12:00:05.635893 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 12:00:05.635893 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad3d7563-2012-4051-bf39-aa57137b407b could not be found. (HTTP 404) (Request-ID: req-5e9ebc5b-27ea-46be-9734-dce63b641ad5) Oct 11 12:00:05.635893 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:00:05.635893 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:00:05.635893 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:00:05.637180 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:00:05.637180 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 11 12:00:05.637180 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 11 12:00:05.637180 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 12:00:05.637180 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 12:00:05.637180 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 12:00:05.637180 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 12:00:05.637180 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 12:00:05.637180 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 12:00:05.637180 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 12:00:05.637180 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 12:00:05.637180 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 12:00:05.637180 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 12:00:05.637180 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 12:00:05.637180 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 12:00:05.637180 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 12:00:05.637180 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 12:00:05.637180 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 12:00:05.637180 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 12:00:05.638636 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 12:00:05.638636 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 12:00:05.638636 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 12:00:05.638636 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 12:00:05.638636 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad3d7563-2012-4051-bf39-aa57137b407b could not be found. Oct 11 12:00:05.638636 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:00:05.638636 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:00:05.638636 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:00:05.638636 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:00:05.638636 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:00:05.638636 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:00:05.638636 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:00:05.638636 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:00:05.638636 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 12:00:05.638636 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 12:00:05.638636 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:00:05.638636 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:00:05.638636 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 11 12:00:05.638636 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:00:05.640377 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad3d7563-2012-4051-bf39-aa57137b407b could not be found. Oct 11 12:00:05.640377 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:00:05.640377 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:00:05.640377 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:00:05.640377 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:00:05.640377 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:00:05.640377 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:00:05.640377 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:00:05.640377 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:00:05.640377 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad3d7563-2012-4051-bf39-aa57137b407b could not be found. Oct 11 12:00:05.640377 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:00:05.640377 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-60a8c1a0-47ed-4dac-b679-6b615afb6fae tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] Returning 404 to user: Volume ad3d7563-2012-4051-bf39-aa57137b407b could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:00:05.640377 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-60a8c1a0-47ed-4dac-b679-6b615afb6fae tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/ad3d7563-2012-4051-bf39-aa57137b407b" status: 404 len: 109 microversion: 2.1 time: 0.174655 Oct 11 12:00:05.641348 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 12/21] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Oct 11 12:00:05 2022] GET /compute/v2.1/os-volumes/ad3d7563-2012-4051-bf39-aa57137b407b => generated 109 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:00:05.652997 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-ab846fbf-3608-4d22-853b-43e3154157cc tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] Calling method '.version_select at 0x7fd40753f430>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:06.007723 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.wsgi [None req-ab846fbf-3608-4d22-853b-43e3154157cc tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] HTTP exception thrown: Volume ad3d7563-2012-4051-bf39-aa57137b407b could not be found. Oct 11 12:00:06.013476 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-ab846fbf-3608-4d22-853b-43e3154157cc tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] Request method failure captured: Oct 11 12:00:06.013476 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: request: DELETE /compute/v2.1/os-volumes/ad3d7563-2012-4051-bf39-aa57137b407b HTTP/1.1 Oct 11 12:00:06.013476 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept: application/json Oct 11 12:00:06.013476 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept-Encoding: identity Oct 11 12:00:06.013476 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Connection: close Oct 11 12:00:06.013476 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Length: 0 Oct 11 12:00:06.013476 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Type: application/json Oct 11 12:00:06.013476 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Host: 10.222.0.59 Oct 11 12:00:06.013476 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Openstack-System-Scope: None Oct 11 12:00:06.013476 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: User-Agent: python-urllib3/1.26.12 Oct 11 12:00:06.013476 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Auth-Token: gAAAAABjRVqxJLhyvfadZHRlqauKgRf_uzhORlwM4Ypy1QhfuoPK7yp4bFZ6vKvLxLSfp-eYjvjdL234L5lZis9xVdkAbTmdYCmHEDknp9hOc69El2DvlP8ZPrimOfcURr6_M_m8eVj7_h7g_JKIl2v0NyCGIWHs-WTX8edLlpu9f13O2S4T9AM Oct 11 12:00:06.013476 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Id: None Oct 11 12:00:06.013476 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Name: None Oct 11 12:00:06.013476 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Identity-Status: Confirmed Oct 11 12:00:06.013476 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Is-Admin-Project: True Oct 11 12:00:06.013476 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Id: default Oct 11 12:00:06.013476 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Name: Default Oct 11 12:00:06.013476 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Id: 81ed94c4abf74746bb798c6cf80173ca Oct 11 12:00:06.013476 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1117192870 Oct 11 12:00:06.013476 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Role: reader,member Oct 11 12:00:06.013476 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Roles: reader,member Oct 11 12:00:06.015094 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/81ed94c4abf74746bb798c6cf80173ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_81ed94c4abf74746bb798c6cf80173ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/81ed94c4abf74746bb798c6cf80173ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/81ed94c4abf74746bb798c6cf80173ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:00:06.015094 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1117192870 Oct 11 12:00:06.015094 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Id: 81ed94c4abf74746bb798c6cf80173ca Oct 11 12:00:06.015094 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1117192870 Oct 11 12:00:06.015094 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User: tempest-VolumesSnapshotsTestJSON-1117192870-project Oct 11 12:00:06.015094 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Id: default Oct 11 12:00:06.015094 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Name: Default Oct 11 12:00:06.015094 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Id: 443b625c635944189820425cea6c5722 Oct 11 12:00:06.015094 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1117192870-project Oct 11 12:00:06.015094 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: method: Oct 11 12:00:06.015094 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: exception: Volume ad3d7563-2012-4051-bf39-aa57137b407b could not be found. Oct 11 12:00:06.015094 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: action_args: {'id': 'ad3d7563-2012-4051-bf39-aa57137b407b'} Oct 11 12:00:06.015094 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:00:06.015887 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:00:06.015887 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 12:00:06.015887 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 12:00:06.015887 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 12:00:06.015887 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 12:00:06.015887 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 12:00:06.015887 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 12:00:06.015887 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 12:00:06.015887 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 12:00:06.015887 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 12:00:06.015887 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 12:00:06.015887 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 12:00:06.015887 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 12:00:06.015887 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 12:00:06.015887 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 12:00:06.015887 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad3d7563-2012-4051-bf39-aa57137b407b could not be found. (HTTP 404) (Request-ID: req-2db3fa76-7a40-41a3-bf3d-a58b65865d40) Oct 11 12:00:06.015887 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:00:06.015887 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:00:06.015887 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:00:06.017247 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:00:06.017247 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 11 12:00:06.017247 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 11 12:00:06.017247 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 12:00:06.017247 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 12:00:06.017247 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 12:00:06.017247 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 12:00:06.017247 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 12:00:06.017247 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 12:00:06.017247 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 12:00:06.017247 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 12:00:06.017247 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 12:00:06.017247 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 12:00:06.017247 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 12:00:06.017247 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 12:00:06.017247 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 12:00:06.017247 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 12:00:06.017247 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 12:00:06.017247 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 12:00:06.018342 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 12:00:06.018342 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 12:00:06.018342 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 12:00:06.018342 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 12:00:06.018342 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad3d7563-2012-4051-bf39-aa57137b407b could not be found. Oct 11 12:00:06.018342 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:00:06.018342 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:00:06.018342 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:00:06.018342 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:00:06.018342 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:00:06.018342 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:00:06.018342 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:00:06.018342 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:00:06.018342 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 12:00:06.018342 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 12:00:06.018342 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:00:06.018342 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:00:06.018342 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 11 12:00:06.018342 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:00:06.021325 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad3d7563-2012-4051-bf39-aa57137b407b could not be found. Oct 11 12:00:06.021325 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:00:06.021325 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:00:06.021325 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:00:06.021325 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:00:06.021325 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:00:06.021325 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:00:06.021325 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:00:06.021325 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:00:06.021325 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad3d7563-2012-4051-bf39-aa57137b407b could not be found. Oct 11 12:00:06.021325 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:00:06.025501 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-ab846fbf-3608-4d22-853b-43e3154157cc tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] Returning 404 to user: Volume ad3d7563-2012-4051-bf39-aa57137b407b could not be found. {{(pid=118994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:00:06.025501 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-ab846fbf-3608-4d22-853b-43e3154157cc tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/ad3d7563-2012-4051-bf39-aa57137b407b" status: 404 len: 109 microversion: 2.1 time: 0.381744 Oct 11 12:00:06.033332 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 10/22] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Oct 11 12:00:05 2022] DELETE /compute/v2.1/os-volumes/ad3d7563-2012-4051-bf39-aa57137b407b => generated 109 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 12:00:06.046215 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-1e6bb3e3-2b4e-4263-9a88-ec89b28643f0 tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] Calling method '.version_select at 0x7fd4074a48b0>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:06.138314 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.wsgi [None req-1e6bb3e3-2b4e-4263-9a88-ec89b28643f0 tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] HTTP exception thrown: Volume ad3d7563-2012-4051-bf39-aa57137b407b could not be found. Oct 11 12:00:06.144753 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-1e6bb3e3-2b4e-4263-9a88-ec89b28643f0 tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] Request method failure captured: Oct 11 12:00:06.144753 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: request: GET /compute/v2.1/os-volumes/ad3d7563-2012-4051-bf39-aa57137b407b HTTP/1.1 Oct 11 12:00:06.144753 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept: application/json Oct 11 12:00:06.144753 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept-Encoding: identity Oct 11 12:00:06.144753 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Connection: close Oct 11 12:00:06.144753 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Length: 0 Oct 11 12:00:06.144753 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Type: application/json Oct 11 12:00:06.144753 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Host: 10.222.0.59 Oct 11 12:00:06.144753 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Openstack-System-Scope: None Oct 11 12:00:06.144753 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: User-Agent: python-urllib3/1.26.12 Oct 11 12:00:06.144753 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Auth-Token: gAAAAABjRVqxJLhyvfadZHRlqauKgRf_uzhORlwM4Ypy1QhfuoPK7yp4bFZ6vKvLxLSfp-eYjvjdL234L5lZis9xVdkAbTmdYCmHEDknp9hOc69El2DvlP8ZPrimOfcURr6_M_m8eVj7_h7g_JKIl2v0NyCGIWHs-WTX8edLlpu9f13O2S4T9AM Oct 11 12:00:06.144753 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Id: None Oct 11 12:00:06.144753 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Name: None Oct 11 12:00:06.144753 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Identity-Status: Confirmed Oct 11 12:00:06.144753 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Is-Admin-Project: True Oct 11 12:00:06.144753 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Id: default Oct 11 12:00:06.144753 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Name: Default Oct 11 12:00:06.144753 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Id: 81ed94c4abf74746bb798c6cf80173ca Oct 11 12:00:06.144753 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1117192870 Oct 11 12:00:06.144753 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Role: reader,member Oct 11 12:00:06.144753 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Roles: reader,member Oct 11 12:00:06.146330 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/81ed94c4abf74746bb798c6cf80173ca"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_81ed94c4abf74746bb798c6cf80173ca"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/81ed94c4abf74746bb798c6cf80173ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/81ed94c4abf74746bb798c6cf80173ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:00:06.146330 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1117192870 Oct 11 12:00:06.146330 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Id: 81ed94c4abf74746bb798c6cf80173ca Oct 11 12:00:06.146330 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1117192870 Oct 11 12:00:06.146330 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User: tempest-VolumesSnapshotsTestJSON-1117192870-project Oct 11 12:00:06.146330 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Id: default Oct 11 12:00:06.146330 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Name: Default Oct 11 12:00:06.146330 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Id: 443b625c635944189820425cea6c5722 Oct 11 12:00:06.146330 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1117192870-project Oct 11 12:00:06.146330 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: method: Oct 11 12:00:06.146330 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: exception: Volume ad3d7563-2012-4051-bf39-aa57137b407b could not be found. Oct 11 12:00:06.146330 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: action_args: {'id': 'ad3d7563-2012-4051-bf39-aa57137b407b'} Oct 11 12:00:06.146330 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:00:06.147284 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:00:06.147284 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 12:00:06.147284 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 12:00:06.147284 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 12:00:06.147284 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 12:00:06.147284 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 12:00:06.147284 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 12:00:06.147284 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 12:00:06.147284 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 12:00:06.147284 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 12:00:06.147284 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 12:00:06.147284 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 12:00:06.147284 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 12:00:06.147284 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 12:00:06.147284 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 12:00:06.147284 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ad3d7563-2012-4051-bf39-aa57137b407b could not be found. (HTTP 404) (Request-ID: req-cd30d20f-0c60-4407-a507-c3c7032a711c) Oct 11 12:00:06.147284 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:00:06.147284 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:00:06.147284 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:00:06.148588 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:00:06.148588 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 11 12:00:06.148588 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 11 12:00:06.148588 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 12:00:06.148588 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 12:00:06.148588 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 12:00:06.148588 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 12:00:06.148588 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 12:00:06.148588 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 12:00:06.148588 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 12:00:06.148588 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 12:00:06.148588 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 12:00:06.148588 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 12:00:06.148588 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 12:00:06.148588 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 12:00:06.148588 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 12:00:06.148588 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 12:00:06.148588 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 12:00:06.148588 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 12:00:06.149988 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 12:00:06.149988 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 12:00:06.149988 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 12:00:06.149988 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 12:00:06.149988 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ad3d7563-2012-4051-bf39-aa57137b407b could not be found. Oct 11 12:00:06.149988 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:00:06.149988 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:00:06.149988 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:00:06.149988 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:00:06.149988 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:00:06.149988 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:00:06.149988 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:00:06.149988 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:00:06.149988 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 12:00:06.149988 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 12:00:06.149988 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:00:06.149988 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:00:06.149988 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 11 12:00:06.149988 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:00:06.151640 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ad3d7563-2012-4051-bf39-aa57137b407b could not be found. Oct 11 12:00:06.151640 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:00:06.151640 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:00:06.151640 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:00:06.151640 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:00:06.151640 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:00:06.151640 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:00:06.151640 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:00:06.151640 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:00:06.151640 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ad3d7563-2012-4051-bf39-aa57137b407b could not be found. Oct 11 12:00:06.151640 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:00:06.151640 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-1e6bb3e3-2b4e-4263-9a88-ec89b28643f0 tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] Returning 404 to user: Volume ad3d7563-2012-4051-bf39-aa57137b407b could not be found. {{(pid=118994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:00:06.151640 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-1e6bb3e3-2b4e-4263-9a88-ec89b28643f0 tempest-VolumesSnapshotsTestJSON-1117192870 tempest-VolumesSnapshotsTestJSON-1117192870-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/ad3d7563-2012-4051-bf39-aa57137b407b" status: 404 len: 109 microversion: 2.1 time: 0.111362 Oct 11 12:00:06.153754 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 11/23] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Oct 11 12:00:06 2022] GET /compute/v2.1/os-volumes/ad3d7563-2012-4051-bf39-aa57137b407b => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:00:06.229795 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-dc45aae5-ccfa-4409-806c-7063ac858e8d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-369161367", "imageRef": "09bcc8f8-a32f-4ec8-9ab2-a98964ad6a01", "flavorRef": "452", "networks": [{"uuid": "2d6676f7-49e3-4a5a-97e6-c03f6ae12d7e"}]}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:00:06.649261 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.network.neutron [None req-dc45aae5-ccfa-4409-806c-7063ac858e8d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] validate_networks() for [('2d6676f7-49e3-4a5a-97e6-c03f6ae12d7e', None, None, None, None, None)] {{(pid=118995) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 12:00:09.878193 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-a54eec08-d52f-442f-9d31-3b48eb0c6f5d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1402024610", "imageRef": "09bcc8f8-a32f-4ec8-9ab2-a98964ad6a01", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:00:10.048363 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.network.neutron [None req-a54eec08-d52f-442f-9d31-3b48eb0c6f5d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] validate_networks() for [('12e948e6-0dda-4a26-9a91-d284707ceba8', None, None, None, None, None)] {{(pid=118994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 12:00:10.576380 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-dc45aae5-ccfa-4409-806c-7063ac858e8d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Flavor limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 12:00:10.577458 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-dc45aae5-ccfa-4409-806c-7063ac858e8d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Image limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 12:00:10.578078 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-dc45aae5-ccfa-4409-806c-7063ac858e8d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Flavor pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 12:00:10.580602 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-dc45aae5-ccfa-4409-806c-7063ac858e8d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Image pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 12:00:10.581469 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-dc45aae5-ccfa-4409-806c-7063ac858e8d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 12:00:10.621518 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dc45aae5-ccfa-4409-806c-7063ac858e8d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:10.624334 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dc45aae5-ccfa-4409-806c-7063ac858e8d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:10.624792 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dc45aae5-ccfa-4409-806c-7063ac858e8d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:10.625601 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dc45aae5-ccfa-4409-806c-7063ac858e8d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:10.626741 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dc45aae5-ccfa-4409-806c-7063ac858e8d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:10.628079 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dc45aae5-ccfa-4409-806c-7063ac858e8d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:10.751406 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-dc45aae5-ccfa-4409-806c-7063ac858e8d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Getting quotas for project bbb66bfd69114f489c0bced30cc1b0b9. Resources: {'ram', 'instances', 'cores'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 12:00:10.766444 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-dc45aae5-ccfa-4409-806c-7063ac858e8d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Getting quotas for user d1619ed83ae546a7ac2219c055ca4076 and project bbb66bfd69114f489c0bced30cc1b0b9. Resources: {'ram', 'instances', 'cores'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 12:00:10.803356 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-dc45aae5-ccfa-4409-806c-7063ac858e8d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Going to run 1 instances... {{(pid=118995) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 12:00:10.808720 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-dc45aae5-ccfa-4409-806c-7063ac858e8d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09bcc8f8-a32f-4ec8-9ab2-a98964ad6a01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118995) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 12:00:10.993012 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-dc45aae5-ccfa-4409-806c-7063ac858e8d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.305686 Oct 11 12:00:10.994451 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 13/24] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Oct 11 12:00:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 5308 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 12:00:11.022227 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-04f6aa4f-9d2e-4529-9251-3a9687672f40 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:11.023366 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-04f6aa4f-9d2e-4529-9251-3a9687672f40 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:11.495393 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-04f6aa4f-9d2e-4529-9251-3a9687672f40 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:11.564975 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-04f6aa4f-9d2e-4529-9251-3a9687672f40 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1214 microversion: 2.1 time: 0.549488 Oct 11 12:00:11.569116 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 14/25] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:11 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1214 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:12.530302 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-a54eec08-d52f-442f-9d31-3b48eb0c6f5d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Flavor limits 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 12:00:12.531768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-a54eec08-d52f-442f-9d31-3b48eb0c6f5d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Image limits 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 12:00:12.532475 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-a54eec08-d52f-442f-9d31-3b48eb0c6f5d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Flavor pref 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 12:00:12.533059 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-a54eec08-d52f-442f-9d31-3b48eb0c6f5d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Image pref 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 12:00:12.533769 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-a54eec08-d52f-442f-9d31-3b48eb0c6f5d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 12:00:12.564476 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a54eec08-d52f-442f-9d31-3b48eb0c6f5d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:12.573808 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a54eec08-d52f-442f-9d31-3b48eb0c6f5d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:12.574143 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a54eec08-d52f-442f-9d31-3b48eb0c6f5d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:12.578458 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a54eec08-d52f-442f-9d31-3b48eb0c6f5d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:12.579430 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a54eec08-d52f-442f-9d31-3b48eb0c6f5d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:12.579825 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a54eec08-d52f-442f-9d31-3b48eb0c6f5d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:12.609763 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ee5d53c7-9293-4a44-bb33-cffae7fc82b0 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:12.610993 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ee5d53c7-9293-4a44-bb33-cffae7fc82b0 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:12.663555 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-a54eec08-d52f-442f-9d31-3b48eb0c6f5d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Getting quotas for project e3e6a648f46646cea42b910d02e0628f. Resources: {'ram', 'instances', 'cores'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 12:00:12.680488 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-a54eec08-d52f-442f-9d31-3b48eb0c6f5d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Getting quotas for user c58107eee1b94541a330c26d7b82a53b and project e3e6a648f46646cea42b910d02e0628f. Resources: {'ram', 'instances', 'cores'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 12:00:12.723036 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-a54eec08-d52f-442f-9d31-3b48eb0c6f5d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Going to run 1 instances... {{(pid=118994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 12:00:12.730929 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-a54eec08-d52f-442f-9d31-3b48eb0c6f5d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09bcc8f8-a32f-4ec8-9ab2-a98964ad6a01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 12:00:12.878228 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-a54eec08-d52f-442f-9d31-3b48eb0c6f5d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.356736 Oct 11 12:00:12.886814 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 12/26] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Oct 11 12:00:09 2022] POST /compute/v2.1/servers => generated 383 bytes in 3366 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 12:00:12.901783 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-76a8eb60-29fd-4003-a03b-62a6b16822d9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:12.906228 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-76a8eb60-29fd-4003-a03b-62a6b16822d9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:12.997039 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ee5d53c7-9293-4a44-bb33-cffae7fc82b0 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:13.021193 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ee5d53c7-9293-4a44-bb33-cffae7fc82b0 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1214 microversion: 2.1 time: 0.400399 Oct 11 12:00:13.022307 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 15/27] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:12 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1214 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:13.223790 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-76a8eb60-29fd-4003-a03b-62a6b16822d9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:13.266935 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-76a8eb60-29fd-4003-a03b-62a6b16822d9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1222 microversion: 2.1 time: 0.369406 Oct 11 12:00:13.277715 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 13/28] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:12 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1222 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:00:13.606466 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-43f63bae-bd37-47b2-885b-1192bbc4e6c1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-309781088", "imageRef": "09bcc8f8-a32f-4ec8-9ab2-a98964ad6a01", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:00:13.771379 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.network.neutron [None req-43f63bae-bd37-47b2-885b-1192bbc4e6c1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] validate_networks() for [('12e948e6-0dda-4a26-9a91-d284707ceba8', None, None, None, None, None)] {{(pid=118994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 12:00:13.951931 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f4dad352-63f8-4362-900a-541014431484 tempest-VolumesGetTestJSON-2095857916 tempest-VolumesGetTestJSON-2095857916-project] Action: 'create', calling method: .version_select at 0x7fd406befdc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-666145539", "metadata": {"Type": "work"}}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:00:15.345014 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-43f63bae-bd37-47b2-885b-1192bbc4e6c1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Flavor limits 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 12:00:15.345680 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-43f63bae-bd37-47b2-885b-1192bbc4e6c1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Image limits 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 12:00:15.346736 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-43f63bae-bd37-47b2-885b-1192bbc4e6c1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Flavor pref 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 12:00:15.348033 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-43f63bae-bd37-47b2-885b-1192bbc4e6c1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Image pref 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 12:00:15.349097 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-43f63bae-bd37-47b2-885b-1192bbc4e6c1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 12:00:15.398647 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-43f63bae-bd37-47b2-885b-1192bbc4e6c1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:15.399429 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-43f63bae-bd37-47b2-885b-1192bbc4e6c1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:15.406454 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-43f63bae-bd37-47b2-885b-1192bbc4e6c1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:15.408182 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-43f63bae-bd37-47b2-885b-1192bbc4e6c1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:15.414940 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-43f63bae-bd37-47b2-885b-1192bbc4e6c1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:15.423694 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-43f63bae-bd37-47b2-885b-1192bbc4e6c1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:15.501194 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-43f63bae-bd37-47b2-885b-1192bbc4e6c1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Getting quotas for project e3e6a648f46646cea42b910d02e0628f. Resources: {'ram', 'instances', 'cores'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 12:00:15.517627 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-43f63bae-bd37-47b2-885b-1192bbc4e6c1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Getting quotas for user c58107eee1b94541a330c26d7b82a53b and project e3e6a648f46646cea42b910d02e0628f. Resources: {'ram', 'instances', 'cores'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 12:00:15.552142 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f4dad352-63f8-4362-900a-541014431484 tempest-VolumesGetTestJSON-2095857916 tempest-VolumesGetTestJSON-2095857916-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.494270 Oct 11 12:00:15.563470 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 16/29] 10.222.0.59 () {60 vars in 1156 bytes} [Tue Oct 11 12:00:13 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2506 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 11 12:00:15.567492 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-43f63bae-bd37-47b2-885b-1192bbc4e6c1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Going to run 1 instances... {{(pid=118994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 12:00:15.582829 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a7f075d8-edb5-4d58-a924-49d9fa3a705d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:15.583903 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-43f63bae-bd37-47b2-885b-1192bbc4e6c1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09bcc8f8-a32f-4ec8-9ab2-a98964ad6a01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 12:00:15.585830 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a7f075d8-edb5-4d58-a924-49d9fa3a705d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:15.608345 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a7f075d8-edb5-4d58-a924-49d9fa3a705d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:15.609953 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a7f075d8-edb5-4d58-a924-49d9fa3a705d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:15.610622 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a7f075d8-edb5-4d58-a924-49d9fa3a705d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:15.613060 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a7f075d8-edb5-4d58-a924-49d9fa3a705d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:15.614804 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a7f075d8-edb5-4d58-a924-49d9fa3a705d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:15.616179 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a7f075d8-edb5-4d58-a924-49d9fa3a705d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:15.777243 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-43f63bae-bd37-47b2-885b-1192bbc4e6c1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.174981 Oct 11 12:00:15.782957 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 14/30] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Oct 11 12:00:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 2181 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 12:00:15.814423 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-9dea7ea4-1ea4-4aba-a286-f3c75c2e122b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1402875916", "imageRef": "09bcc8f8-a32f-4ec8-9ab2-a98964ad6a01", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "55e10b58-1f19-4291-9200-8a870118bbcb"}], "security_groups": [{"name": "tempest-securitygroup--57720646"}], "key_name": "tempest-keypair-1946892434", "user_data": "}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:00:16.048778 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a7f075d8-edb5-4d58-a924-49d9fa3a705d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:16.077533 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a7f075d8-edb5-4d58-a924-49d9fa3a705d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1210 microversion: 2.1 time: 0.508516 Oct 11 12:00:16.078141 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 17/31] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:15 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1210 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:16.108918 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3765ae19-11a4-43f1-9d14-253af31f979f tempest-VolumesGetTestJSON-2095857916 tempest-VolumesGetTestJSON-2095857916-project] Calling method '.version_select at 0x7fd406b7cca0>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:16.177083 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.network.neutron [None req-9dea7ea4-1ea4-4aba-a286-f3c75c2e122b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] validate_networks() for [('55e10b58-1f19-4291-9200-8a870118bbcb', None, None, None, None, None)] {{(pid=118994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 12:00:16.260624 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-3765ae19-11a4-43f1-9d14-253af31f979f tempest-VolumesGetTestJSON-2095857916 tempest-VolumesGetTestJSON-2095857916-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/587a294a-af90-462d-9698-0a58ce695387" status: 200 len: 352 microversion: 2.1 time: 0.156044 Oct 11 12:00:16.262970 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 18/32] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Oct 11 12:00:16 2022] GET /compute/v2.1/os-volumes/587a294a-af90-462d-9698-0a58ce695387 => generated 352 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:00:16.268593 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d4f941ab-944b-4fd4-9d9a-1b5b41bff659 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:16.269429 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d4f941ab-944b-4fd4-9d9a-1b5b41bff659 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:16.361255 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d4f941ab-944b-4fd4-9d9a-1b5b41bff659 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:16.378977 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d4f941ab-944b-4fd4-9d9a-1b5b41bff659 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1221 microversion: 2.1 time: 0.114019 Oct 11 12:00:16.380220 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 19/33] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:16 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1221 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:17.106703 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-1370ee79-57dd-435b-9e56-2af8c3b98ad4 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:17.108322 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-1370ee79-57dd-435b-9e56-2af8c3b98ad4 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:17.120017 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1370ee79-57dd-435b-9e56-2af8c3b98ad4 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:17.121308 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1370ee79-57dd-435b-9e56-2af8c3b98ad4 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:17.121939 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1370ee79-57dd-435b-9e56-2af8c3b98ad4 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:17.122920 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1370ee79-57dd-435b-9e56-2af8c3b98ad4 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:17.124271 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1370ee79-57dd-435b-9e56-2af8c3b98ad4 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:17.125532 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1370ee79-57dd-435b-9e56-2af8c3b98ad4 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:17.258232 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-1370ee79-57dd-435b-9e56-2af8c3b98ad4 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:17.283930 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-1370ee79-57dd-435b-9e56-2af8c3b98ad4 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1210 microversion: 2.1 time: 0.181900 Oct 11 12:00:17.284519 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 20/34] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:17 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1210 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:17.312664 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7c5dbd64-8a2f-489b-8d59-6c301ee3e332 tempest-VolumesGetTestJSON-2095857916 tempest-VolumesGetTestJSON-2095857916-project] Calling method '.version_select at 0x7fd406b2ba60>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:17.441822 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7c5dbd64-8a2f-489b-8d59-6c301ee3e332 tempest-VolumesGetTestJSON-2095857916 tempest-VolumesGetTestJSON-2095857916-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/587a294a-af90-462d-9698-0a58ce695387" status: 200 len: 352 microversion: 2.1 time: 0.139369 Oct 11 12:00:17.442412 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 21/35] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Oct 11 12:00:17 2022] GET /compute/v2.1/os-volumes/587a294a-af90-462d-9698-0a58ce695387 => generated 352 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:00:17.448170 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a0ef54ed-e3c9-45e3-983e-557a35dc6335 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:17.449178 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a0ef54ed-e3c9-45e3-983e-557a35dc6335 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:17.459084 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0ef54ed-e3c9-45e3-983e-557a35dc6335 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:17.459885 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0ef54ed-e3c9-45e3-983e-557a35dc6335 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:17.460552 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0ef54ed-e3c9-45e3-983e-557a35dc6335 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:17.461496 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0ef54ed-e3c9-45e3-983e-557a35dc6335 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:17.462158 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0ef54ed-e3c9-45e3-983e-557a35dc6335 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:17.462803 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0ef54ed-e3c9-45e3-983e-557a35dc6335 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:17.563830 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a0ef54ed-e3c9-45e3-983e-557a35dc6335 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:17.596429 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a0ef54ed-e3c9-45e3-983e-557a35dc6335 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1225 microversion: 2.1 time: 0.152151 Oct 11 12:00:17.597109 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 22/36] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:17 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1225 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:18.313586 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e1cd43a0-dfad-453b-b71d-aa0eff9c7b00 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:18.319131 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e1cd43a0-dfad-453b-b71d-aa0eff9c7b00 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:18.348619 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e1cd43a0-dfad-453b-b71d-aa0eff9c7b00 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:18.356487 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e1cd43a0-dfad-453b-b71d-aa0eff9c7b00 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:18.357431 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e1cd43a0-dfad-453b-b71d-aa0eff9c7b00 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:18.364491 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e1cd43a0-dfad-453b-b71d-aa0eff9c7b00 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:18.390519 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e1cd43a0-dfad-453b-b71d-aa0eff9c7b00 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:18.393536 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e1cd43a0-dfad-453b-b71d-aa0eff9c7b00 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:18.703557 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-9dea7ea4-1ea4-4aba-a286-f3c75c2e122b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Flavor limits 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 12:00:18.704391 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-9dea7ea4-1ea4-4aba-a286-f3c75c2e122b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Image limits 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 12:00:18.704555 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-9dea7ea4-1ea4-4aba-a286-f3c75c2e122b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Flavor pref 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 12:00:18.704897 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-9dea7ea4-1ea4-4aba-a286-f3c75c2e122b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Image pref 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 12:00:18.705459 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-9dea7ea4-1ea4-4aba-a286-f3c75c2e122b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 12:00:18.725379 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9dea7ea4-1ea4-4aba-a286-f3c75c2e122b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:18.725864 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9dea7ea4-1ea4-4aba-a286-f3c75c2e122b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:18.729059 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9dea7ea4-1ea4-4aba-a286-f3c75c2e122b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:18.731698 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9dea7ea4-1ea4-4aba-a286-f3c75c2e122b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:18.734074 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9dea7ea4-1ea4-4aba-a286-f3c75c2e122b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:18.734808 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9dea7ea4-1ea4-4aba-a286-f3c75c2e122b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:18.850498 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e1cd43a0-dfad-453b-b71d-aa0eff9c7b00 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:18.867658 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-9dea7ea4-1ea4-4aba-a286-f3c75c2e122b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Getting quotas for project c83f971a0ae04288a5c6dc87d3370979. Resources: {'ram', 'instances', 'cores'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 12:00:18.880805 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-9dea7ea4-1ea4-4aba-a286-f3c75c2e122b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Getting quotas for user 41d3680dda7c4cc8aeb6d086efca0775 and project c83f971a0ae04288a5c6dc87d3370979. Resources: {'ram', 'instances', 'cores'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 12:00:18.887071 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e1cd43a0-dfad-453b-b71d-aa0eff9c7b00 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1266 microversion: 2.1 time: 0.581192 Oct 11 12:00:18.887688 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 23/37] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:18 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1266 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:18.897772 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8af25d6b-afe2-40ae-815a-a5b7d63e9991 tempest-VolumesGetTestJSON-2095857916 tempest-VolumesGetTestJSON-2095857916-project] Calling method '.version_select at 0x7fd406b2b8b0>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:18.923546 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-9dea7ea4-1ea4-4aba-a286-f3c75c2e122b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Going to run 1 instances... {{(pid=118994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 12:00:18.934758 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-9dea7ea4-1ea4-4aba-a286-f3c75c2e122b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09bcc8f8-a32f-4ec8-9ab2-a98964ad6a01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 12:00:19.032948 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-9dea7ea4-1ea4-4aba-a286-f3c75c2e122b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 3.248038 Oct 11 12:00:19.048109 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 15/38] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Oct 11 12:00:15 2022] POST /compute/v2.1/servers => generated 400 bytes in 3264 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 12:00:19.059459 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-5a1bfc53-4588-42b4-affb-a3db5d42cfbe tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:19.060653 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-5a1bfc53-4588-42b4-affb-a3db5d42cfbe tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:19.093663 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5a1bfc53-4588-42b4-affb-a3db5d42cfbe tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:19.094301 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5a1bfc53-4588-42b4-affb-a3db5d42cfbe tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:19.095020 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5a1bfc53-4588-42b4-affb-a3db5d42cfbe tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:19.096336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5a1bfc53-4588-42b4-affb-a3db5d42cfbe tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:19.096954 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5a1bfc53-4588-42b4-affb-a3db5d42cfbe tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:19.097790 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5a1bfc53-4588-42b4-affb-a3db5d42cfbe tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:19.271642 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8af25d6b-afe2-40ae-815a-a5b7d63e9991 tempest-VolumesGetTestJSON-2095857916 tempest-VolumesGetTestJSON-2095857916-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/587a294a-af90-462d-9698-0a58ce695387" status: 200 len: 352 microversion: 2.1 time: 0.382851 Oct 11 12:00:19.272811 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 24/39] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Oct 11 12:00:18 2022] GET /compute/v2.1/os-volumes/587a294a-af90-462d-9698-0a58ce695387 => generated 352 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:00:19.279825 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0ad5bd3e-47d2-4a46-a398-b46644a91cf4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:19.280767 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0ad5bd3e-47d2-4a46-a398-b46644a91cf4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:19.415878 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0ad5bd3e-47d2-4a46-a398-b46644a91cf4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:19.425304 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0ad5bd3e-47d2-4a46-a398-b46644a91cf4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1242 microversion: 2.1 time: 0.151221 Oct 11 12:00:19.425912 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 25/40] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:19 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1242 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:19.437126 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-5a1bfc53-4588-42b4-affb-a3db5d42cfbe tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:19.468857 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-5a1bfc53-4588-42b4-affb-a3db5d42cfbe tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1225 microversion: 2.1 time: 0.418512 Oct 11 12:00:19.470192 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 16/41] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:19 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1225 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:19.928206 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-db43bd02-62cb-4404-a33c-5be252a8ea0d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:19.928206 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-db43bd02-62cb-4404-a33c-5be252a8ea0d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:19.954970 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-db43bd02-62cb-4404-a33c-5be252a8ea0d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:19.955829 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-db43bd02-62cb-4404-a33c-5be252a8ea0d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:19.956628 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-db43bd02-62cb-4404-a33c-5be252a8ea0d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:19.964228 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-db43bd02-62cb-4404-a33c-5be252a8ea0d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:19.965883 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-db43bd02-62cb-4404-a33c-5be252a8ea0d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:19.966627 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-db43bd02-62cb-4404-a33c-5be252a8ea0d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:20.176942 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-db43bd02-62cb-4404-a33c-5be252a8ea0d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:20.207173 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-db43bd02-62cb-4404-a33c-5be252a8ea0d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1266 microversion: 2.1 time: 0.299774 Oct 11 12:00:20.208593 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 26/42] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:19 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1266 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:20.289151 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-3da3f512-52a2-43f4-8b5f-5301c86e35aa tempest-VolumesGetTestJSON-2095857916 tempest-VolumesGetTestJSON-2095857916-project] Calling method '.version_select at 0x7fd406b0e820>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:20.453938 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-09eb30a3-5f3e-4aff-8532-95c71d3c7225 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:20.454665 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-09eb30a3-5f3e-4aff-8532-95c71d3c7225 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:20.478859 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-09eb30a3-5f3e-4aff-8532-95c71d3c7225 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:20.479500 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-09eb30a3-5f3e-4aff-8532-95c71d3c7225 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:20.479955 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-09eb30a3-5f3e-4aff-8532-95c71d3c7225 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:20.491048 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-09eb30a3-5f3e-4aff-8532-95c71d3c7225 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:20.491366 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-09eb30a3-5f3e-4aff-8532-95c71d3c7225 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:20.491823 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-09eb30a3-5f3e-4aff-8532-95c71d3c7225 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:20.683248 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=2 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:20.780979 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-3da3f512-52a2-43f4-8b5f-5301c86e35aa tempest-VolumesGetTestJSON-2095857916 tempest-VolumesGetTestJSON-2095857916-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/587a294a-af90-462d-9698-0a58ce695387" status: 200 len: 352 microversion: 2.1 time: 0.496862 Oct 11 12:00:20.789416 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 17/43] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Oct 11 12:00:20 2022] GET /compute/v2.1/os-volumes/587a294a-af90-462d-9698-0a58ce695387 => generated 352 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:00:20.823937 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-9992dc22-6185-4611-9b93-aa41cb9eec44 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:20.824884 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-9992dc22-6185-4611-9b93-aa41cb9eec44 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:20.848671 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9992dc22-6185-4611-9b93-aa41cb9eec44 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:20.849682 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9992dc22-6185-4611-9b93-aa41cb9eec44 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:20.850924 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9992dc22-6185-4611-9b93-aa41cb9eec44 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:20.855238 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-09eb30a3-5f3e-4aff-8532-95c71d3c7225 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:20.861234 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9992dc22-6185-4611-9b93-aa41cb9eec44 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:20.863600 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9992dc22-6185-4611-9b93-aa41cb9eec44 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:20.869699 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9992dc22-6185-4611-9b93-aa41cb9eec44 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:20.916847 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-09eb30a3-5f3e-4aff-8532-95c71d3c7225 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1246 microversion: 2.1 time: 0.464267 Oct 11 12:00:20.921569 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 27/44] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:20 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1246 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:21.126326 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-9992dc22-6185-4611-9b93-aa41cb9eec44 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:21.206353 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-9992dc22-6185-4611-9b93-aa41cb9eec44 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1217 microversion: 2.1 time: 0.421125 Oct 11 12:00:21.207931 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 18/45] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:20 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1217 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:21.238151 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-96a50236-a21b-4d9a-abd1-ef9c2c5f15ee tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:21.239176 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-96a50236-a21b-4d9a-abd1-ef9c2c5f15ee tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:21.257045 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-96a50236-a21b-4d9a-abd1-ef9c2c5f15ee tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:21.257855 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-96a50236-a21b-4d9a-abd1-ef9c2c5f15ee tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:21.265301 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-96a50236-a21b-4d9a-abd1-ef9c2c5f15ee tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:21.266618 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-96a50236-a21b-4d9a-abd1-ef9c2c5f15ee tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:21.269388 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-96a50236-a21b-4d9a-abd1-ef9c2c5f15ee tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:21.270012 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-96a50236-a21b-4d9a-abd1-ef9c2c5f15ee tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:21.415618 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-96a50236-a21b-4d9a-abd1-ef9c2c5f15ee tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:21.428574 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-96a50236-a21b-4d9a-abd1-ef9c2c5f15ee tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1272 microversion: 2.1 time: 0.195896 Oct 11 12:00:21.433051 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 28/46] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:21 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1272 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:21.802881 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-fad57a01-5ea3-4a6d-868b-28ee9039932c tempest-VolumesGetTestJSON-2095857916 tempest-VolumesGetTestJSON-2095857916-project] Calling method '.version_select at 0x7fd406b12550>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:21.948766 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f11a26b0-a811-4a88-89db-33678f53057f tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:21.949539 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f11a26b0-a811-4a88-89db-33678f53057f tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:21.966421 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f11a26b0-a811-4a88-89db-33678f53057f tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:21.969130 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f11a26b0-a811-4a88-89db-33678f53057f tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:21.973579 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f11a26b0-a811-4a88-89db-33678f53057f tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:21.977031 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f11a26b0-a811-4a88-89db-33678f53057f tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:21.977800 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f11a26b0-a811-4a88-89db-33678f53057f tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:21.982612 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f11a26b0-a811-4a88-89db-33678f53057f tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:22.018062 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-fad57a01-5ea3-4a6d-868b-28ee9039932c tempest-VolumesGetTestJSON-2095857916 tempest-VolumesGetTestJSON-2095857916-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/587a294a-af90-462d-9698-0a58ce695387" status: 200 len: 353 microversion: 2.1 time: 0.224973 Oct 11 12:00:22.018674 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 19/47] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Oct 11 12:00:21 2022] GET /compute/v2.1/os-volumes/587a294a-af90-462d-9698-0a58ce695387 => generated 353 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 12:00:22.046427 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-b62ef8e5-65ef-4bb1-9b88-bb1175ce2927 tempest-VolumesGetTestJSON-2095857916 tempest-VolumesGetTestJSON-2095857916-project] Calling method '.version_select at 0x7fd406b12f70>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:22.193614 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-b62ef8e5-65ef-4bb1-9b88-bb1175ce2927 tempest-VolumesGetTestJSON-2095857916 tempest-VolumesGetTestJSON-2095857916-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/587a294a-af90-462d-9698-0a58ce695387" status: 200 len: 353 microversion: 2.1 time: 0.153225 Oct 11 12:00:22.194416 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 20/48] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Oct 11 12:00:22 2022] GET /compute/v2.1/os-volumes/587a294a-af90-462d-9698-0a58ce695387 => generated 353 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 12:00:22.228677 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-bcc893bf-a8e8-4e06-84e3-279e567a71fb tempest-VolumesGetTestJSON-2095857916 tempest-VolumesGetTestJSON-2095857916-project] Calling method '.version_select at 0x7fd406b1b700>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:22.461451 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-bcc893bf-a8e8-4e06-84e3-279e567a71fb tempest-VolumesGetTestJSON-2095857916 tempest-VolumesGetTestJSON-2095857916-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/587a294a-af90-462d-9698-0a58ce695387" status: 202 len: 0 microversion: 2.1 time: 0.240309 Oct 11 12:00:22.463503 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 21/49] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Oct 11 12:00:22 2022] DELETE /compute/v2.1/os-volumes/587a294a-af90-462d-9698-0a58ce695387 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 12:00:22.477126 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-32a5f706-d437-4d5b-abea-1b041c4921a6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:22.479777 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-32a5f706-d437-4d5b-abea-1b041c4921a6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:22.505460 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-32a5f706-d437-4d5b-abea-1b041c4921a6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:22.506031 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-32a5f706-d437-4d5b-abea-1b041c4921a6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:22.509601 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-32a5f706-d437-4d5b-abea-1b041c4921a6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:22.512302 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-32a5f706-d437-4d5b-abea-1b041c4921a6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:22.513168 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-32a5f706-d437-4d5b-abea-1b041c4921a6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:22.513640 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-32a5f706-d437-4d5b-abea-1b041c4921a6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:22.542803 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f11a26b0-a811-4a88-89db-33678f53057f tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:22.604660 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f11a26b0-a811-4a88-89db-33678f53057f tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1238 microversion: 2.1 time: 0.659621 Oct 11 12:00:22.607691 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 29/50] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:21 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1238 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:00:22.626407 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c6e14b3e-4216-4378-8cd7-75fd5544a934 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:22.631781 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c6e14b3e-4216-4378-8cd7-75fd5544a934 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:22.654482 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c6e14b3e-4216-4378-8cd7-75fd5544a934 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:22.658470 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c6e14b3e-4216-4378-8cd7-75fd5544a934 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:22.664633 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c6e14b3e-4216-4378-8cd7-75fd5544a934 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:22.666382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c6e14b3e-4216-4378-8cd7-75fd5544a934 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:22.667984 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c6e14b3e-4216-4378-8cd7-75fd5544a934 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:22.676819 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c6e14b3e-4216-4378-8cd7-75fd5544a934 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:23.065955 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c6e14b3e-4216-4378-8cd7-75fd5544a934 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:23.080531 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c6e14b3e-4216-4378-8cd7-75fd5544a934 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1272 microversion: 2.1 time: 0.471281 Oct 11 12:00:23.081437 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 30/51] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:22 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1272 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:23.102969 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-16c12ee8-e544-402d-84ba-848b6c9e6047 tempest-VolumesGetTestJSON-2095857916 tempest-VolumesGetTestJSON-2095857916-project] Calling method '.version_select at 0x7fd406ad2ca0>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:23.427526 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-16c12ee8-e544-402d-84ba-848b6c9e6047 tempest-VolumesGetTestJSON-2095857916 tempest-VolumesGetTestJSON-2095857916-project] HTTP exception thrown: Volume 587a294a-af90-462d-9698-0a58ce695387 could not be found. Oct 11 12:00:23.430304 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-16c12ee8-e544-402d-84ba-848b6c9e6047 tempest-VolumesGetTestJSON-2095857916 tempest-VolumesGetTestJSON-2095857916-project] Request method failure captured: Oct 11 12:00:23.430304 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/os-volumes/587a294a-af90-462d-9698-0a58ce695387 HTTP/1.1 Oct 11 12:00:23.430304 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 11 12:00:23.430304 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 11 12:00:23.430304 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Connection: close Oct 11 12:00:23.430304 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 11 12:00:23.430304 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 11 12:00:23.430304 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Host: 10.222.0.59 Oct 11 12:00:23.430304 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 11 12:00:23.430304 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 11 12:00:23.430304 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjRVrM69X3goXrYyQtNSDWe2ybCorD62fv5H27NHVookMagLbdEtoZSVUOsFijPg4WhQK7xB7w-u_8TpOF1BcyKfJp0mAOheAWhjI52BmqZEY_incJIOny7dVQjwDrU64Om6jMYK1jD7hjQaOKS-Jw03doQPqTIunhaedZ15Ee1bJ_d-U Oct 11 12:00:23.430304 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 11 12:00:23.430304 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 11 12:00:23.430304 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 11 12:00:23.430304 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 11 12:00:23.430304 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 11 12:00:23.430304 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 11 12:00:23.430304 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Id: 85a10ff66bc5457899b9abae9b27b903 Oct 11 12:00:23.430304 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-VolumesGetTestJSON-2095857916 Oct 11 12:00:23.430304 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Role: reader,member Oct 11 12:00:23.430304 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Roles: reader,member Oct 11 12:00:23.431670 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/85a10ff66bc5457899b9abae9b27b903"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_85a10ff66bc5457899b9abae9b27b903"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/85a10ff66bc5457899b9abae9b27b903"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/85a10ff66bc5457899b9abae9b27b903"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:00:23.431670 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-VolumesGetTestJSON-2095857916 Oct 11 12:00:23.431670 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 85a10ff66bc5457899b9abae9b27b903 Oct 11 12:00:23.431670 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-VolumesGetTestJSON-2095857916 Oct 11 12:00:23.431670 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User: tempest-VolumesGetTestJSON-2095857916-project Oct 11 12:00:23.431670 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 11 12:00:23.431670 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 11 12:00:23.431670 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Id: 456d8be3a30840a19a3cdb8b82662bff Oct 11 12:00:23.431670 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-VolumesGetTestJSON-2095857916-project Oct 11 12:00:23.431670 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: method: Oct 11 12:00:23.431670 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: exception: Volume 587a294a-af90-462d-9698-0a58ce695387 could not be found. Oct 11 12:00:23.431670 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: action_args: {'id': '587a294a-af90-462d-9698-0a58ce695387'} Oct 11 12:00:23.431670 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:00:23.432316 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:00:23.432316 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 12:00:23.432316 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 12:00:23.432316 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 12:00:23.432316 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 12:00:23.432316 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 12:00:23.432316 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 12:00:23.432316 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 12:00:23.432316 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 12:00:23.432316 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 12:00:23.432316 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 12:00:23.432316 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 12:00:23.432316 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 12:00:23.432316 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 12:00:23.432316 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 12:00:23.432316 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 587a294a-af90-462d-9698-0a58ce695387 could not be found. (HTTP 404) (Request-ID: req-911294d3-5fd3-496c-8385-f77215a28032) Oct 11 12:00:23.432316 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:00:23.432316 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:00:23.432316 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:00:23.433290 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:00:23.433290 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 11 12:00:23.433290 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 11 12:00:23.433290 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 12:00:23.433290 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 12:00:23.433290 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 12:00:23.433290 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 12:00:23.433290 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 12:00:23.433290 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 12:00:23.433290 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 12:00:23.433290 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 12:00:23.433290 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 12:00:23.433290 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 12:00:23.433290 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 12:00:23.433290 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 12:00:23.433290 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 12:00:23.433290 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 12:00:23.433290 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 12:00:23.433290 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 12:00:23.434356 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 12:00:23.434356 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 12:00:23.434356 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 12:00:23.434356 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 12:00:23.434356 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 587a294a-af90-462d-9698-0a58ce695387 could not be found. Oct 11 12:00:23.434356 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:00:23.434356 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:00:23.434356 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:00:23.434356 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:00:23.434356 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:00:23.434356 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:00:23.434356 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:00:23.434356 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:00:23.434356 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 12:00:23.434356 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 12:00:23.434356 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:00:23.434356 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:00:23.434356 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 11 12:00:23.434356 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:00:23.435318 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 587a294a-af90-462d-9698-0a58ce695387 could not be found. Oct 11 12:00:23.435318 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:00:23.435318 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:00:23.435318 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:00:23.435318 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:00:23.435318 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:00:23.435318 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:00:23.435318 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:00:23.435318 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:00:23.435318 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 587a294a-af90-462d-9698-0a58ce695387 could not be found. Oct 11 12:00:23.435318 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:00:23.438412 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-16c12ee8-e544-402d-84ba-848b6c9e6047 tempest-VolumesGetTestJSON-2095857916 tempest-VolumesGetTestJSON-2095857916-project] Returning 404 to user: Volume 587a294a-af90-462d-9698-0a58ce695387 could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:00:23.439710 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-16c12ee8-e544-402d-84ba-848b6c9e6047 tempest-VolumesGetTestJSON-2095857916 tempest-VolumesGetTestJSON-2095857916-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/587a294a-af90-462d-9698-0a58ce695387" status: 404 len: 109 microversion: 2.1 time: 0.348499 Oct 11 12:00:23.440566 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 31/52] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Oct 11 12:00:23 2022] GET /compute/v2.1/os-volumes/587a294a-af90-462d-9698-0a58ce695387 => generated 109 bytes in 350 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:00:23.630055 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-47b6aeb2-e4e4-4617-aa76-f68ba7bb995b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:23.630971 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-47b6aeb2-e4e4-4617-aa76-f68ba7bb995b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:23.651869 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-47b6aeb2-e4e4-4617-aa76-f68ba7bb995b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:23.654811 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-47b6aeb2-e4e4-4617-aa76-f68ba7bb995b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:23.656994 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-47b6aeb2-e4e4-4617-aa76-f68ba7bb995b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:23.659326 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-47b6aeb2-e4e4-4617-aa76-f68ba7bb995b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:23.662242 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-47b6aeb2-e4e4-4617-aa76-f68ba7bb995b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:23.663070 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-47b6aeb2-e4e4-4617-aa76-f68ba7bb995b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:23.856868 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-32a5f706-d437-4d5b-abea-1b041c4921a6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:23.876144 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-32a5f706-d437-4d5b-abea-1b041c4921a6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1281 microversion: 2.1 time: 1.409353 Oct 11 12:00:23.890586 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 22/53] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:22 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1281 bytes in 1424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:24.109013 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-4bfb94a5-baaa-4aa8-93fc-f85dd6a04487 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:24.110740 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-4bfb94a5-baaa-4aa8-93fc-f85dd6a04487 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:24.136627 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4bfb94a5-baaa-4aa8-93fc-f85dd6a04487 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:24.142043 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4bfb94a5-baaa-4aa8-93fc-f85dd6a04487 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:24.150848 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4bfb94a5-baaa-4aa8-93fc-f85dd6a04487 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:24.153729 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4bfb94a5-baaa-4aa8-93fc-f85dd6a04487 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:24.154841 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4bfb94a5-baaa-4aa8-93fc-f85dd6a04487 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:24.158980 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4bfb94a5-baaa-4aa8-93fc-f85dd6a04487 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:24.443834 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-47b6aeb2-e4e4-4617-aa76-f68ba7bb995b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:24.491160 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-47b6aeb2-e4e4-4617-aa76-f68ba7bb995b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1294 microversion: 2.1 time: 0.848939 Oct 11 12:00:24.493700 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 32/54] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:23 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1294 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:00:24.678705 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-4bfb94a5-baaa-4aa8-93fc-f85dd6a04487 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:24.692723 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-4bfb94a5-baaa-4aa8-93fc-f85dd6a04487 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1314 microversion: 2.1 time: 0.591625 Oct 11 12:00:24.714959 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 23/55] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:24 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1314 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:24.904055 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-639cd45a-a572-4e88-aad4-a1831fdcc89d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:24.905317 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-639cd45a-a572-4e88-aad4-a1831fdcc89d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:24.914382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-639cd45a-a572-4e88-aad4-a1831fdcc89d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:24.915027 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-639cd45a-a572-4e88-aad4-a1831fdcc89d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:24.915715 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-639cd45a-a572-4e88-aad4-a1831fdcc89d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:24.916673 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-639cd45a-a572-4e88-aad4-a1831fdcc89d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:24.917174 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-639cd45a-a572-4e88-aad4-a1831fdcc89d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:24.917817 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-639cd45a-a572-4e88-aad4-a1831fdcc89d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:25.179846 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-639cd45a-a572-4e88-aad4-a1831fdcc89d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:25.235200 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-639cd45a-a572-4e88-aad4-a1831fdcc89d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1321 microversion: 2.1 time: 0.334971 Oct 11 12:00:25.251257 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 33/56] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:24 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1321 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:25.533771 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-9e70c6e1-4031-4e0d-9960-82c3b3528e23 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:25.536271 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-9e70c6e1-4031-4e0d-9960-82c3b3528e23 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:25.577116 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9e70c6e1-4031-4e0d-9960-82c3b3528e23 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:25.580827 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9e70c6e1-4031-4e0d-9960-82c3b3528e23 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:25.586280 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9e70c6e1-4031-4e0d-9960-82c3b3528e23 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:25.598708 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9e70c6e1-4031-4e0d-9960-82c3b3528e23 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:25.600611 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9e70c6e1-4031-4e0d-9960-82c3b3528e23 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:25.601827 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9e70c6e1-4031-4e0d-9960-82c3b3528e23 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:25.737239 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9c4a582b-7930-466b-89d0-b3b0973c1662 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:25.740772 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9c4a582b-7930-466b-89d0-b3b0973c1662 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:25.775853 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c4a582b-7930-466b-89d0-b3b0973c1662 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:25.779127 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c4a582b-7930-466b-89d0-b3b0973c1662 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:25.784155 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c4a582b-7930-466b-89d0-b3b0973c1662 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:25.786597 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c4a582b-7930-466b-89d0-b3b0973c1662 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:25.790248 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c4a582b-7930-466b-89d0-b3b0973c1662 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:25.791652 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c4a582b-7930-466b-89d0-b3b0973c1662 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:25.863059 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-9e70c6e1-4031-4e0d-9960-82c3b3528e23 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:25.881771 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-9e70c6e1-4031-4e0d-9960-82c3b3528e23 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1302 microversion: 2.1 time: 0.362589 Oct 11 12:00:25.883185 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 24/57] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:25 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1302 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:26.084894 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-9c4a582b-7930-466b-89d0-b3b0973c1662 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:26.100084 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9c4a582b-7930-466b-89d0-b3b0973c1662 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1314 microversion: 2.1 time: 0.384388 Oct 11 12:00:26.114622 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 34/58] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:25 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:26.284250 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-94bcfab0-7521-46eb-8b55-551c40080475 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:26.285551 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-94bcfab0-7521-46eb-8b55-551c40080475 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:26.296707 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-94bcfab0-7521-46eb-8b55-551c40080475 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:26.297838 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-94bcfab0-7521-46eb-8b55-551c40080475 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:26.298602 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-94bcfab0-7521-46eb-8b55-551c40080475 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:26.299774 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-94bcfab0-7521-46eb-8b55-551c40080475 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:26.300562 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-94bcfab0-7521-46eb-8b55-551c40080475 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:26.301254 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-94bcfab0-7521-46eb-8b55-551c40080475 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:26.625147 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-94bcfab0-7521-46eb-8b55-551c40080475 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:26.638219 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-94bcfab0-7521-46eb-8b55-551c40080475 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1321 microversion: 2.1 time: 0.360379 Oct 11 12:00:26.642795 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 25/59] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:26 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1321 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:00:26.913382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-687c4a79-d064-4662-a54c-bb78bfae8849 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:26.916276 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-687c4a79-d064-4662-a54c-bb78bfae8849 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:26.950473 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-687c4a79-d064-4662-a54c-bb78bfae8849 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:26.955156 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-687c4a79-d064-4662-a54c-bb78bfae8849 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:26.955932 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-687c4a79-d064-4662-a54c-bb78bfae8849 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:26.957315 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-687c4a79-d064-4662-a54c-bb78bfae8849 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:26.958449 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-687c4a79-d064-4662-a54c-bb78bfae8849 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:26.958931 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-687c4a79-d064-4662-a54c-bb78bfae8849 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:27.081612 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-687c4a79-d064-4662-a54c-bb78bfae8849 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:27.092096 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-687c4a79-d064-4662-a54c-bb78bfae8849 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1302 microversion: 2.1 time: 0.187364 Oct 11 12:00:27.093519 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 35/60] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:26 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1302 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:27.127436 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-ab987d8e-5a91-4409-8220-e28be8234526 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:27.128245 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-ab987d8e-5a91-4409-8220-e28be8234526 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:27.138269 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ab987d8e-5a91-4409-8220-e28be8234526 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:27.139045 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ab987d8e-5a91-4409-8220-e28be8234526 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:27.139523 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ab987d8e-5a91-4409-8220-e28be8234526 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:27.140402 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ab987d8e-5a91-4409-8220-e28be8234526 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:27.140965 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ab987d8e-5a91-4409-8220-e28be8234526 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:27.141603 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ab987d8e-5a91-4409-8220-e28be8234526 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:27.352168 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-ab987d8e-5a91-4409-8220-e28be8234526 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:27.361543 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-ab987d8e-5a91-4409-8220-e28be8234526 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1314 microversion: 2.1 time: 0.238425 Oct 11 12:00:27.362242 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 26/61] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:27 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:27.680628 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-40b63212-709a-475e-9e36-575d12b2b699 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:27.697534 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-40b63212-709a-475e-9e36-575d12b2b699 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:27.727944 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-40b63212-709a-475e-9e36-575d12b2b699 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:27.729288 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-40b63212-709a-475e-9e36-575d12b2b699 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:27.730862 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-40b63212-709a-475e-9e36-575d12b2b699 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:27.734621 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-40b63212-709a-475e-9e36-575d12b2b699 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:27.735760 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-40b63212-709a-475e-9e36-575d12b2b699 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:27.739240 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-40b63212-709a-475e-9e36-575d12b2b699 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:28.133919 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-623a9f08-0eb7-45fb-8d0b-7c7335e56ea8 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:28.135223 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-623a9f08-0eb7-45fb-8d0b-7c7335e56ea8 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:28.172156 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-623a9f08-0eb7-45fb-8d0b-7c7335e56ea8 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:28.180828 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-623a9f08-0eb7-45fb-8d0b-7c7335e56ea8 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:28.186695 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-623a9f08-0eb7-45fb-8d0b-7c7335e56ea8 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:28.195583 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-623a9f08-0eb7-45fb-8d0b-7c7335e56ea8 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:28.196606 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-623a9f08-0eb7-45fb-8d0b-7c7335e56ea8 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:28.197622 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-623a9f08-0eb7-45fb-8d0b-7c7335e56ea8 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:28.313981 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-40b63212-709a-475e-9e36-575d12b2b699 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:28.328055 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-40b63212-709a-475e-9e36-575d12b2b699 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1321 microversion: 2.1 time: 0.659859 Oct 11 12:00:28.329888 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 36/62] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:27 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1321 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:00:28.402220 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-eb69d494-717f-4b6c-bf97-c859d153130d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:28.403620 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-eb69d494-717f-4b6c-bf97-c859d153130d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:28.428744 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eb69d494-717f-4b6c-bf97-c859d153130d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:28.432179 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eb69d494-717f-4b6c-bf97-c859d153130d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:28.433549 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eb69d494-717f-4b6c-bf97-c859d153130d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:28.434528 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eb69d494-717f-4b6c-bf97-c859d153130d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:28.460784 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eb69d494-717f-4b6c-bf97-c859d153130d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:28.465390 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eb69d494-717f-4b6c-bf97-c859d153130d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:28.485093 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-623a9f08-0eb7-45fb-8d0b-7c7335e56ea8 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:28.512721 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-623a9f08-0eb7-45fb-8d0b-7c7335e56ea8 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1312 microversion: 2.1 time: 0.384852 Oct 11 12:00:28.542397 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 27/63] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:28 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1312 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:29.166659 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-eb69d494-717f-4b6c-bf97-c859d153130d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:29.193448 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-eb69d494-717f-4b6c-bf97-c859d153130d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1314 microversion: 2.1 time: 0.792824 Oct 11 12:00:29.210803 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 37/64] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:28 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1314 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:00:29.362597 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-3b8c1903-79f0-4b38-954e-2dadd06f4726 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:29.366774 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-3b8c1903-79f0-4b38-954e-2dadd06f4726 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:29.373758 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell0:SELECT=6 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:29.383796 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell0:SELECT=24 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:29.409948 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3b8c1903-79f0-4b38-954e-2dadd06f4726 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:29.412156 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3b8c1903-79f0-4b38-954e-2dadd06f4726 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:29.413423 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3b8c1903-79f0-4b38-954e-2dadd06f4726 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:29.419133 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3b8c1903-79f0-4b38-954e-2dadd06f4726 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:29.421653 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3b8c1903-79f0-4b38-954e-2dadd06f4726 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:29.422853 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3b8c1903-79f0-4b38-954e-2dadd06f4726 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:29.561201 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-10f370b8-b064-4bae-a7a3-d42bcf5cd1e1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:29.562109 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-10f370b8-b064-4bae-a7a3-d42bcf5cd1e1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:29.573731 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=14 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:29.581496 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-10f370b8-b064-4bae-a7a3-d42bcf5cd1e1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:29.582873 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-10f370b8-b064-4bae-a7a3-d42bcf5cd1e1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:29.583601 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-10f370b8-b064-4bae-a7a3-d42bcf5cd1e1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:29.591132 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-10f370b8-b064-4bae-a7a3-d42bcf5cd1e1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:29.594383 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-10f370b8-b064-4bae-a7a3-d42bcf5cd1e1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:29.596615 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-10f370b8-b064-4bae-a7a3-d42bcf5cd1e1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:29.861686 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-10f370b8-b064-4bae-a7a3-d42bcf5cd1e1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:29.895753 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-10f370b8-b064-4bae-a7a3-d42bcf5cd1e1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1300 microversion: 2.1 time: 0.339311 Oct 11 12:00:29.901475 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 38/65] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:29 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1300 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:30.026150 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-3b8c1903-79f0-4b38-954e-2dadd06f4726 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:30.068973 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-3b8c1903-79f0-4b38-954e-2dadd06f4726 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1321 microversion: 2.1 time: 0.711328 Oct 11 12:00:30.072214 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 28/66] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:29 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1321 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:30.228294 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-cf02a9e4-4b7b-4bc8-b9eb-9920d668e325 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:30.242206 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-cf02a9e4-4b7b-4bc8-b9eb-9920d668e325 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:30.271559 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cf02a9e4-4b7b-4bc8-b9eb-9920d668e325 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:30.274826 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cf02a9e4-4b7b-4bc8-b9eb-9920d668e325 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:30.276056 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cf02a9e4-4b7b-4bc8-b9eb-9920d668e325 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:30.279914 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cf02a9e4-4b7b-4bc8-b9eb-9920d668e325 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:30.281254 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cf02a9e4-4b7b-4bc8-b9eb-9920d668e325 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:30.286288 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cf02a9e4-4b7b-4bc8-b9eb-9920d668e325 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:30.308112 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=100 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:30.937383 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-a1b3eac4-dc5b-4faa-baac-79dc4103b437 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:30.938312 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-a1b3eac4-dc5b-4faa-baac-79dc4103b437 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:30.941619 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=10 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:30.996358 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a1b3eac4-dc5b-4faa-baac-79dc4103b437 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:31.002289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a1b3eac4-dc5b-4faa-baac-79dc4103b437 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:31.006332 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a1b3eac4-dc5b-4faa-baac-79dc4103b437 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:31.011462 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a1b3eac4-dc5b-4faa-baac-79dc4103b437 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:31.017756 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a1b3eac4-dc5b-4faa-baac-79dc4103b437 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:31.020675 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a1b3eac4-dc5b-4faa-baac-79dc4103b437 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:31.702664 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-a1b3eac4-dc5b-4faa-baac-79dc4103b437 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:31.719947 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-a1b3eac4-dc5b-4faa-baac-79dc4103b437 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1300 microversion: 2.1 time: 0.787730 Oct 11 12:00:31.737668 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 29/67] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:30 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1300 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:31.745558 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-11745db5-c642-49ad-8b57-a9141acb037d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:31.751278 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-11745db5-c642-49ad-8b57-a9141acb037d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:31.793370 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-11745db5-c642-49ad-8b57-a9141acb037d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:31.797665 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-11745db5-c642-49ad-8b57-a9141acb037d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:31.798583 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-11745db5-c642-49ad-8b57-a9141acb037d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:31.801572 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-11745db5-c642-49ad-8b57-a9141acb037d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:31.802416 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-11745db5-c642-49ad-8b57-a9141acb037d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:31.803551 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-11745db5-c642-49ad-8b57-a9141acb037d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:31.849011 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-cf02a9e4-4b7b-4bc8-b9eb-9920d668e325 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:31.877391 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-cf02a9e4-4b7b-4bc8-b9eb-9920d668e325 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1314 microversion: 2.1 time: 1.657136 Oct 11 12:00:31.887387 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 39/68] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:30 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1314 bytes in 1668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:32.811409 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-74453a10-ef33-4fef-93b0-04d27a849106 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:32.812742 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-74453a10-ef33-4fef-93b0-04d27a849106 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:32.858221 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-74453a10-ef33-4fef-93b0-04d27a849106 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:32.865297 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-74453a10-ef33-4fef-93b0-04d27a849106 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:32.871379 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-74453a10-ef33-4fef-93b0-04d27a849106 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:32.880415 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-74453a10-ef33-4fef-93b0-04d27a849106 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:32.884897 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-74453a10-ef33-4fef-93b0-04d27a849106 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:32.885763 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-74453a10-ef33-4fef-93b0-04d27a849106 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:33.956608 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-74453a10-ef33-4fef-93b0-04d27a849106 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:33.984383 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-74453a10-ef33-4fef-93b0-04d27a849106 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1300 microversion: 2.1 time: 1.182120 Oct 11 12:00:33.990116 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 40/69] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:32 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1300 bytes in 1189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:00:34.007132 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ac53cdca-46a5-4c16-bc65-0be69891924e tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:34.008277 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ac53cdca-46a5-4c16-bc65-0be69891924e tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:34.026737 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ac53cdca-46a5-4c16-bc65-0be69891924e tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:34.027439 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ac53cdca-46a5-4c16-bc65-0be69891924e tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:34.028601 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ac53cdca-46a5-4c16-bc65-0be69891924e tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:34.031090 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ac53cdca-46a5-4c16-bc65-0be69891924e tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:34.034714 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ac53cdca-46a5-4c16-bc65-0be69891924e tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:34.035436 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ac53cdca-46a5-4c16-bc65-0be69891924e tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:34.173327 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-11745db5-c642-49ad-8b57-a9141acb037d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:34.191813 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-11745db5-c642-49ad-8b57-a9141acb037d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1321 microversion: 2.1 time: 2.448625 Oct 11 12:00:34.195160 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 30/70] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:31 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1321 bytes in 2456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:34.202351 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-0944b57c-b805-4ecd-8d17-7c0c2ae62cbc tempest-VolumesTestJSON-595916793 tempest-VolumesTestJSON-595916793-project] Calling method '.version_select at 0x7fd406b0edc0>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:34.352226 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-0944b57c-b805-4ecd-8d17-7c0c2ae62cbc tempest-VolumesTestJSON-595916793 tempest-VolumesTestJSON-595916793-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/cbfd2596-634f-4f8a-b058-1fd42751c24c" status: 200 len: 351 microversion: 2.1 time: 0.153877 Oct 11 12:00:34.353601 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 31/71] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Oct 11 12:00:34 2022] GET /compute/v2.1/os-volumes/cbfd2596-634f-4f8a-b058-1fd42751c24c => generated 351 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:00:34.843427 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ac53cdca-46a5-4c16-bc65-0be69891924e tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:34.857733 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ac53cdca-46a5-4c16-bc65-0be69891924e tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1314 microversion: 2.1 time: 0.865611 Oct 11 12:00:34.860192 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 41/72] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:33 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1314 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:35.041777 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-d42b3e11-7726-4466-8700-5179ba24898c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:35.042496 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-d42b3e11-7726-4466-8700-5179ba24898c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:35.052670 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d42b3e11-7726-4466-8700-5179ba24898c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:35.059614 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d42b3e11-7726-4466-8700-5179ba24898c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:35.060763 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d42b3e11-7726-4466-8700-5179ba24898c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:35.062079 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d42b3e11-7726-4466-8700-5179ba24898c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:35.062819 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d42b3e11-7726-4466-8700-5179ba24898c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:35.063544 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d42b3e11-7726-4466-8700-5179ba24898c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:35.244867 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-29f80508-85fb-46af-a27b-24ce2b6db984 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:35.245914 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-29f80508-85fb-46af-a27b-24ce2b6db984 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:35.259204 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-29f80508-85fb-46af-a27b-24ce2b6db984 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:35.259721 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-29f80508-85fb-46af-a27b-24ce2b6db984 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:35.260177 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-29f80508-85fb-46af-a27b-24ce2b6db984 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:35.260928 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-29f80508-85fb-46af-a27b-24ce2b6db984 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:35.261385 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-29f80508-85fb-46af-a27b-24ce2b6db984 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:35.261807 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-29f80508-85fb-46af-a27b-24ce2b6db984 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:35.763368 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-d42b3e11-7726-4466-8700-5179ba24898c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:35.775340 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-d42b3e11-7726-4466-8700-5179ba24898c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1366 microversion: 2.1 time: 0.737611 Oct 11 12:00:35.779039 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 32/73] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:35 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1366 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:35.887907 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-a9e97c52-4e94-45f1-a34e-2267144579d1 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:35.888527 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-a9e97c52-4e94-45f1-a34e-2267144579d1 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:35.895780 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-29f80508-85fb-46af-a27b-24ce2b6db984 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:35.911028 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a9e97c52-4e94-45f1-a34e-2267144579d1 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:35.912619 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a9e97c52-4e94-45f1-a34e-2267144579d1 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:35.914007 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a9e97c52-4e94-45f1-a34e-2267144579d1 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:35.914190 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-29f80508-85fb-46af-a27b-24ce2b6db984 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1321 microversion: 2.1 time: 0.677747 Oct 11 12:00:35.916074 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a9e97c52-4e94-45f1-a34e-2267144579d1 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:35.917200 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a9e97c52-4e94-45f1-a34e-2267144579d1 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:35.918351 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a9e97c52-4e94-45f1-a34e-2267144579d1 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:35.921531 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 42/74] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:35 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1321 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:00:36.151446 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-14f6428a-09fc-47b1-b2de-1b0a9ec58d04 req-84f14e5d-f0e4-4713-80f0-ac788072e03d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6da2ee3-f7c1-4cab-a6bd-096baa684fca", "tag": "4d99dc26-3a74-4c26-8fb0-ce3917c1284f"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:00:36.188536 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:36.194871 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-14f6428a-09fc-47b1-b2de-1b0a9ec58d04 req-84f14e5d-f0e4-4713-80f0-ac788072e03d service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:36.202397 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-14f6428a-09fc-47b1-b2de-1b0a9ec58d04 req-84f14e5d-f0e4-4713-80f0-ac788072e03d service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:36.204203 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-14f6428a-09fc-47b1-b2de-1b0a9ec58d04 req-84f14e5d-f0e4-4713-80f0-ac788072e03d service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:36.264581 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-14f6428a-09fc-47b1-b2de-1b0a9ec58d04 req-84f14e5d-f0e4-4713-80f0-ac788072e03d service nova] Creating event network-changed:4d99dc26-3a74-4c26-8fb0-ce3917c1284f for instance a6da2ee3-f7c1-4cab-a6bd-096baa684fca on hv-cinder-82099 Oct 11 12:00:36.272767 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-14f6428a-09fc-47b1-b2de-1b0a9ec58d04 req-84f14e5d-f0e4-4713-80f0-ac788072e03d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118995) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 12:00:36.273205 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-14f6428a-09fc-47b1-b2de-1b0a9ec58d04 req-84f14e5d-f0e4-4713-80f0-ac788072e03d service nova] Acquired lock "compute-rpcapi-router" {{(pid=118995) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 12:00:36.274332 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2dd51c0d-7e3b-4d03-a662-e4d5912ee81f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:36.274830 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2dd51c0d-7e3b-4d03-a662-e4d5912ee81f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:36.275269 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2dd51c0d-7e3b-4d03-a662-e4d5912ee81f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:36.275992 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2dd51c0d-7e3b-4d03-a662-e4d5912ee81f None None] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:36.276526 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2dd51c0d-7e3b-4d03-a662-e4d5912ee81f None None] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:36.276843 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2dd51c0d-7e3b-4d03-a662-e4d5912ee81f None None] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:36.303277 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.compute.rpcapi [None req-2dd51c0d-7e3b-4d03-a662-e4d5912ee81f None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 11 12:00:36.307802 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2dd51c0d-7e3b-4d03-a662-e4d5912ee81f None None] Releasing lock "compute-rpcapi-router" {{(pid=118995) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 12:00:36.341822 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2dd51c0d-7e3b-4d03-a662-e4d5912ee81f None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.370479 Oct 11 12:00:36.347047 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 43/75] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:00:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:00:36.596231 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-a425211d-45af-4797-813e-23fdcdaf8518 req-f88d6973-ebe4-4960-866a-709f29689db8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70722a52-e702-4e13-a49a-6f2c1161ae35", "tag": "615246f6-a650-4d01-8f0c-205bc002fd3d"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:00:36.667033 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-a425211d-45af-4797-813e-23fdcdaf8518 req-f88d6973-ebe4-4960-866a-709f29689db8 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:36.670486 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-a425211d-45af-4797-813e-23fdcdaf8518 req-f88d6973-ebe4-4960-866a-709f29689db8 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:36.674716 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-a425211d-45af-4797-813e-23fdcdaf8518 req-f88d6973-ebe4-4960-866a-709f29689db8 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:36.728944 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-a425211d-45af-4797-813e-23fdcdaf8518 req-f88d6973-ebe4-4960-866a-709f29689db8 service nova] Creating event network-changed:615246f6-a650-4d01-8f0c-205bc002fd3d for instance 70722a52-e702-4e13-a49a-6f2c1161ae35 on hv-cinder-82099 Oct 11 12:00:36.753877 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-a425211d-45af-4797-813e-23fdcdaf8518 req-f88d6973-ebe4-4960-866a-709f29689db8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.404688 Oct 11 12:00:36.759008 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 44/76] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:00:36.828073 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-953c9c08-0264-4542-b4f9-9f5f0442c88c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:36.829267 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-953c9c08-0264-4542-b4f9-9f5f0442c88c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:36.841710 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-a9e97c52-4e94-45f1-a34e-2267144579d1 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:36.859233 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-953c9c08-0264-4542-b4f9-9f5f0442c88c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:36.863004 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-953c9c08-0264-4542-b4f9-9f5f0442c88c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:36.864736 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-a9e97c52-4e94-45f1-a34e-2267144579d1 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1314 microversion: 2.1 time: 0.981858 Oct 11 12:00:36.864977 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-953c9c08-0264-4542-b4f9-9f5f0442c88c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:36.867025 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 33/77] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:35 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1314 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:00:36.867747 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-953c9c08-0264-4542-b4f9-9f5f0442c88c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:36.871561 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-953c9c08-0264-4542-b4f9-9f5f0442c88c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:36.872250 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-953c9c08-0264-4542-b4f9-9f5f0442c88c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:36.965312 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-7d6a8fd8-9c0d-4f18-bb93-b330d32429b7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:36.966133 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-7d6a8fd8-9c0d-4f18-bb93-b330d32429b7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:36.981997 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7d6a8fd8-9c0d-4f18-bb93-b330d32429b7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:36.982651 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7d6a8fd8-9c0d-4f18-bb93-b330d32429b7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:36.983112 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7d6a8fd8-9c0d-4f18-bb93-b330d32429b7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:36.983845 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7d6a8fd8-9c0d-4f18-bb93-b330d32429b7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:36.984298 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7d6a8fd8-9c0d-4f18-bb93-b330d32429b7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:36.984714 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7d6a8fd8-9c0d-4f18-bb93-b330d32429b7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:37.100968 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-953c9c08-0264-4542-b4f9-9f5f0442c88c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:37.115846 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-953c9c08-0264-4542-b4f9-9f5f0442c88c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1366 microversion: 2.1 time: 0.296013 Oct 11 12:00:37.130709 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 45/78] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:36 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1366 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:37.188195 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-7d6a8fd8-9c0d-4f18-bb93-b330d32429b7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:37.201394 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-7d6a8fd8-9c0d-4f18-bb93-b330d32429b7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1321 microversion: 2.1 time: 0.258226 Oct 11 12:00:37.202721 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 34/79] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:36 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:37.895835 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-676fcc97-b918-460b-a4fc-26f399bce8b2 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:37.897100 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-676fcc97-b918-460b-a4fc-26f399bce8b2 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:37.909500 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-676fcc97-b918-460b-a4fc-26f399bce8b2 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:37.910428 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-676fcc97-b918-460b-a4fc-26f399bce8b2 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:37.911353 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-676fcc97-b918-460b-a4fc-26f399bce8b2 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:37.912681 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-676fcc97-b918-460b-a4fc-26f399bce8b2 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:37.913533 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-676fcc97-b918-460b-a4fc-26f399bce8b2 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:37.916016 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-676fcc97-b918-460b-a4fc-26f399bce8b2 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:38.155750 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-d328bce3-aca1-43a9-bebc-e3a1f30b9071 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:38.156637 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-d328bce3-aca1-43a9-bebc-e3a1f30b9071 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:38.164139 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d328bce3-aca1-43a9-bebc-e3a1f30b9071 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:38.164897 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d328bce3-aca1-43a9-bebc-e3a1f30b9071 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:38.165751 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d328bce3-aca1-43a9-bebc-e3a1f30b9071 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:38.167459 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d328bce3-aca1-43a9-bebc-e3a1f30b9071 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:38.168396 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d328bce3-aca1-43a9-bebc-e3a1f30b9071 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:38.169025 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d328bce3-aca1-43a9-bebc-e3a1f30b9071 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:38.176760 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-676fcc97-b918-460b-a4fc-26f399bce8b2 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:38.192249 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-676fcc97-b918-460b-a4fc-26f399bce8b2 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1314 microversion: 2.1 time: 0.304711 Oct 11 12:00:38.203007 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 46/80] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:37 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:38.243577 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-cf1f3f8f-53a2-4ae9-9062-54dee6da925d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:38.244828 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-cf1f3f8f-53a2-4ae9-9062-54dee6da925d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:38.256180 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cf1f3f8f-53a2-4ae9-9062-54dee6da925d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:38.257028 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cf1f3f8f-53a2-4ae9-9062-54dee6da925d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:38.257799 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cf1f3f8f-53a2-4ae9-9062-54dee6da925d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:38.259113 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cf1f3f8f-53a2-4ae9-9062-54dee6da925d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:38.259941 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cf1f3f8f-53a2-4ae9-9062-54dee6da925d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:38.260906 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cf1f3f8f-53a2-4ae9-9062-54dee6da925d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:38.415547 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-d328bce3-aca1-43a9-bebc-e3a1f30b9071 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:38.434894 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-d328bce3-aca1-43a9-bebc-e3a1f30b9071 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1366 microversion: 2.1 time: 0.283975 Oct 11 12:00:38.438017 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 35/81] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:38 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:00:38.530705 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-cf1f3f8f-53a2-4ae9-9062-54dee6da925d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:38.540207 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-cf1f3f8f-53a2-4ae9-9062-54dee6da925d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1321 microversion: 2.1 time: 0.312419 Oct 11 12:00:38.542100 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 47/82] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:38 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1321 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:38.799258 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-31f73a6e-40ea-47c2-95ce-6b63f47c96f2 req-919990ef-d74a-47c4-b07c-326e706baca0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c49bf4e1-912c-47b2-9761-88325bf6d533", "tag": "9d2064c6-cfc0-4a34-a19a-dfcb06301457"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:00:38.819760 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-31f73a6e-40ea-47c2-95ce-6b63f47c96f2 req-919990ef-d74a-47c4-b07c-326e706baca0 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:38.820549 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-31f73a6e-40ea-47c2-95ce-6b63f47c96f2 req-919990ef-d74a-47c4-b07c-326e706baca0 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:38.821163 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-31f73a6e-40ea-47c2-95ce-6b63f47c96f2 req-919990ef-d74a-47c4-b07c-326e706baca0 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:38.851262 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-31f73a6e-40ea-47c2-95ce-6b63f47c96f2 req-919990ef-d74a-47c4-b07c-326e706baca0 service nova] Creating event network-changed:9d2064c6-cfc0-4a34-a19a-dfcb06301457 for instance c49bf4e1-912c-47b2-9761-88325bf6d533 on hv-cinder-82099 Oct 11 12:00:38.851812 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-31f73a6e-40ea-47c2-95ce-6b63f47c96f2 req-919990ef-d74a-47c4-b07c-326e706baca0 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118994) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 12:00:38.852231 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-31f73a6e-40ea-47c2-95ce-6b63f47c96f2 req-919990ef-d74a-47c4-b07c-326e706baca0 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118994) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 12:00:38.854266 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3084fe0d-53c3-4937-845c-bcacb1d1ab8a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:38.854821 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3084fe0d-53c3-4937-845c-bcacb1d1ab8a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:38.855963 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3084fe0d-53c3-4937-845c-bcacb1d1ab8a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:38.857303 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3084fe0d-53c3-4937-845c-bcacb1d1ab8a None None] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:38.857940 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3084fe0d-53c3-4937-845c-bcacb1d1ab8a None None] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:38.858509 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3084fe0d-53c3-4937-845c-bcacb1d1ab8a None None] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:38.866927 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=100 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:38.872946 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.compute.rpcapi [None req-3084fe0d-53c3-4937-845c-bcacb1d1ab8a None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 11 12:00:38.875360 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3084fe0d-53c3-4937-845c-bcacb1d1ab8a None None] Releasing lock "compute-rpcapi-router" {{(pid=118994) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 12:00:38.915882 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-3084fe0d-53c3-4937-845c-bcacb1d1ab8a None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126406 Oct 11 12:00:38.917387 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 36/83] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:00:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:00:39.237894 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-621d3dc1-2c6b-44a7-a274-3bddd96740a8 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:39.240268 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-621d3dc1-2c6b-44a7-a274-3bddd96740a8 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:39.252094 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-621d3dc1-2c6b-44a7-a274-3bddd96740a8 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:39.253433 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-621d3dc1-2c6b-44a7-a274-3bddd96740a8 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:39.254090 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-621d3dc1-2c6b-44a7-a274-3bddd96740a8 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:39.255426 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-621d3dc1-2c6b-44a7-a274-3bddd96740a8 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:39.256018 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-621d3dc1-2c6b-44a7-a274-3bddd96740a8 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:39.256979 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-621d3dc1-2c6b-44a7-a274-3bddd96740a8 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:39.496199 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-b06623b1-555b-4f73-b7d7-c73341c489ce tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:39.499418 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-b06623b1-555b-4f73-b7d7-c73341c489ce tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:39.517032 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b06623b1-555b-4f73-b7d7-c73341c489ce tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:39.517988 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b06623b1-555b-4f73-b7d7-c73341c489ce tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:39.518961 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b06623b1-555b-4f73-b7d7-c73341c489ce tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:39.520780 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b06623b1-555b-4f73-b7d7-c73341c489ce tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:39.522418 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b06623b1-555b-4f73-b7d7-c73341c489ce tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:39.524176 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b06623b1-555b-4f73-b7d7-c73341c489ce tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:39.728754 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-621d3dc1-2c6b-44a7-a274-3bddd96740a8 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:39.758993 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-621d3dc1-2c6b-44a7-a274-3bddd96740a8 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1314 microversion: 2.1 time: 0.529754 Oct 11 12:00:39.767072 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 48/84] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:39 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1314 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:39.797893 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-aacea6d7-fbe1-4a46-9530-82a344850e50 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:39.814596 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-aacea6d7-fbe1-4a46-9530-82a344850e50 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:39.840334 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aacea6d7-fbe1-4a46-9530-82a344850e50 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:39.842314 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aacea6d7-fbe1-4a46-9530-82a344850e50 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:39.844551 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aacea6d7-fbe1-4a46-9530-82a344850e50 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:39.845755 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aacea6d7-fbe1-4a46-9530-82a344850e50 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:39.846363 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aacea6d7-fbe1-4a46-9530-82a344850e50 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:39.846815 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aacea6d7-fbe1-4a46-9530-82a344850e50 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:39.964175 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-b06623b1-555b-4f73-b7d7-c73341c489ce tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:39.982875 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-b06623b1-555b-4f73-b7d7-c73341c489ce tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1366 microversion: 2.1 time: 0.502490 Oct 11 12:00:39.984698 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 37/85] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:39 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1366 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:40.231628 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-aacea6d7-fbe1-4a46-9530-82a344850e50 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:40.247752 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-aacea6d7-fbe1-4a46-9530-82a344850e50 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1321 microversion: 2.1 time: 0.477877 Oct 11 12:00:40.250190 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 49/86] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:39 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1321 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:40.812530 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-e50acd6e-af82-4b91-891a-04d099af518a tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:40.813612 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-e50acd6e-af82-4b91-891a-04d099af518a tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:40.820843 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e50acd6e-af82-4b91-891a-04d099af518a tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:40.821348 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e50acd6e-af82-4b91-891a-04d099af518a tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:40.821792 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e50acd6e-af82-4b91-891a-04d099af518a tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:40.822516 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e50acd6e-af82-4b91-891a-04d099af518a tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:40.823034 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e50acd6e-af82-4b91-891a-04d099af518a tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:40.823655 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e50acd6e-af82-4b91-891a-04d099af518a tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:41.034118 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-046fb7a9-401e-4478-8849-be1bb668c767 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:41.035953 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-046fb7a9-401e-4478-8849-be1bb668c767 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:41.052859 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-046fb7a9-401e-4478-8849-be1bb668c767 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:41.053703 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-046fb7a9-401e-4478-8849-be1bb668c767 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:41.054603 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-046fb7a9-401e-4478-8849-be1bb668c767 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:41.056369 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-046fb7a9-401e-4478-8849-be1bb668c767 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:41.057121 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-046fb7a9-401e-4478-8849-be1bb668c767 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:41.058054 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-046fb7a9-401e-4478-8849-be1bb668c767 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:41.059754 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-e50acd6e-af82-4b91-891a-04d099af518a tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:41.072591 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-e50acd6e-af82-4b91-891a-04d099af518a tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1314 microversion: 2.1 time: 0.264187 Oct 11 12:00:41.073504 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 38/87] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:40 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:41.264125 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-046fb7a9-401e-4478-8849-be1bb668c767 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:41.279507 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-046fb7a9-401e-4478-8849-be1bb668c767 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1366 microversion: 2.1 time: 0.259301 Oct 11 12:00:41.294880 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-a18ebc40-5f96-46a4-ba54-a6483f997cb5 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:41.295139 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 50/88] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:41 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:00:41.296176 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-a18ebc40-5f96-46a4-ba54-a6483f997cb5 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:41.318509 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a18ebc40-5f96-46a4-ba54-a6483f997cb5 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:41.319507 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a18ebc40-5f96-46a4-ba54-a6483f997cb5 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:41.320336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a18ebc40-5f96-46a4-ba54-a6483f997cb5 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:41.321707 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a18ebc40-5f96-46a4-ba54-a6483f997cb5 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:41.322640 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a18ebc40-5f96-46a4-ba54-a6483f997cb5 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:41.323471 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a18ebc40-5f96-46a4-ba54-a6483f997cb5 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:41.736793 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-a18ebc40-5f96-46a4-ba54-a6483f997cb5 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:41.754826 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-a18ebc40-5f96-46a4-ba54-a6483f997cb5 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1321 microversion: 2.1 time: 0.470768 Oct 11 12:00:41.756659 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 39/89] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:41 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1321 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:41.891072 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e32b7305-7a48-4607-b47e-b25cefd1bd79 tempest-VolumesTestJSON-595916793 tempest-VolumesTestJSON-595916793-project] Calling method '.version_select at 0x7fd406b2be50>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:41.964115 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e32b7305-7a48-4607-b47e-b25cefd1bd79 tempest-VolumesTestJSON-595916793 tempest-VolumesTestJSON-595916793-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/212fcd90-e549-484e-bbca-bcbd75e86f5b" status: 200 len: 351 microversion: 2.1 time: 0.078986 Oct 11 12:00:41.965056 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 51/90] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Oct 11 12:00:41 2022] GET /compute/v2.1/os-volumes/212fcd90-e549-484e-bbca-bcbd75e86f5b => generated 351 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:00:42.108252 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-8f4560de-0ee9-4d46-a7e0-a4f2e3263cc4 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:42.109721 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-8f4560de-0ee9-4d46-a7e0-a4f2e3263cc4 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:42.118831 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8f4560de-0ee9-4d46-a7e0-a4f2e3263cc4 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:42.120295 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8f4560de-0ee9-4d46-a7e0-a4f2e3263cc4 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:42.121644 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8f4560de-0ee9-4d46-a7e0-a4f2e3263cc4 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:42.122927 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8f4560de-0ee9-4d46-a7e0-a4f2e3263cc4 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:42.123734 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8f4560de-0ee9-4d46-a7e0-a4f2e3263cc4 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:42.124399 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8f4560de-0ee9-4d46-a7e0-a4f2e3263cc4 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:42.323827 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-171f732a-39ec-418c-95c3-7c8c6949375b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:42.326018 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-171f732a-39ec-418c-95c3-7c8c6949375b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:42.333452 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-8f4560de-0ee9-4d46-a7e0-a4f2e3263cc4 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:42.339126 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-171f732a-39ec-418c-95c3-7c8c6949375b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:42.340022 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-171f732a-39ec-418c-95c3-7c8c6949375b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:42.340842 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-171f732a-39ec-418c-95c3-7c8c6949375b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:42.341706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-171f732a-39ec-418c-95c3-7c8c6949375b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:42.342264 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-171f732a-39ec-418c-95c3-7c8c6949375b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:42.342823 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-171f732a-39ec-418c-95c3-7c8c6949375b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:42.343891 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-8f4560de-0ee9-4d46-a7e0-a4f2e3263cc4 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1314 microversion: 2.1 time: 0.239538 Oct 11 12:00:42.344653 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 40/91] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:42 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:00:42.556696 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-171f732a-39ec-418c-95c3-7c8c6949375b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:42.566744 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-171f732a-39ec-418c-95c3-7c8c6949375b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1366 microversion: 2.1 time: 0.251923 Oct 11 12:00:42.567349 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 52/92] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:42 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:42.793403 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-9174181e-64f7-4dfa-a6f8-376e2a04640e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:42.793933 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-9174181e-64f7-4dfa-a6f8-376e2a04640e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:42.802146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9174181e-64f7-4dfa-a6f8-376e2a04640e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:42.802741 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9174181e-64f7-4dfa-a6f8-376e2a04640e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:42.803133 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9174181e-64f7-4dfa-a6f8-376e2a04640e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:42.803875 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9174181e-64f7-4dfa-a6f8-376e2a04640e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:42.804380 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9174181e-64f7-4dfa-a6f8-376e2a04640e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:42.804912 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9174181e-64f7-4dfa-a6f8-376e2a04640e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:43.032146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-9174181e-64f7-4dfa-a6f8-376e2a04640e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:43.046002 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-9174181e-64f7-4dfa-a6f8-376e2a04640e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1321 microversion: 2.1 time: 0.257004 Oct 11 12:00:43.046899 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 41/93] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:42 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:43.372569 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-28b95bf6-1479-4967-a8c2-8cb5aba604e9 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:43.373649 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-28b95bf6-1479-4967-a8c2-8cb5aba604e9 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:43.384743 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-28b95bf6-1479-4967-a8c2-8cb5aba604e9 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:43.385573 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-28b95bf6-1479-4967-a8c2-8cb5aba604e9 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:43.386310 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-28b95bf6-1479-4967-a8c2-8cb5aba604e9 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:43.387598 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-28b95bf6-1479-4967-a8c2-8cb5aba604e9 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:43.388383 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-28b95bf6-1479-4967-a8c2-8cb5aba604e9 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:43.389128 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-28b95bf6-1479-4967-a8c2-8cb5aba604e9 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:43.598781 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-8b56aee9-5183-4c83-a2a8-fa9d604628ca tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:43.599604 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-28b95bf6-1479-4967-a8c2-8cb5aba604e9 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:43.601133 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-8b56aee9-5183-4c83-a2a8-fa9d604628ca tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:43.609305 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-28b95bf6-1479-4967-a8c2-8cb5aba604e9 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1314 microversion: 2.1 time: 0.243938 Oct 11 12:00:43.610235 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8b56aee9-5183-4c83-a2a8-fa9d604628ca tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:43.610419 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 53/94] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:43 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:43.610996 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8b56aee9-5183-4c83-a2a8-fa9d604628ca tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:43.611526 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8b56aee9-5183-4c83-a2a8-fa9d604628ca tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:43.612599 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8b56aee9-5183-4c83-a2a8-fa9d604628ca tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:43.613372 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8b56aee9-5183-4c83-a2a8-fa9d604628ca tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:43.613967 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8b56aee9-5183-4c83-a2a8-fa9d604628ca tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:43.791996 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-8b56aee9-5183-4c83-a2a8-fa9d604628ca tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:43.801565 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-8b56aee9-5183-4c83-a2a8-fa9d604628ca tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1366 microversion: 2.1 time: 0.212670 Oct 11 12:00:43.802319 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 42/95] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:43 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:00:44.074121 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ec2121a8-2af8-41ac-913f-f3d8871655b6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:44.074886 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ec2121a8-2af8-41ac-913f-f3d8871655b6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:44.081978 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ec2121a8-2af8-41ac-913f-f3d8871655b6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:44.082471 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ec2121a8-2af8-41ac-913f-f3d8871655b6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:44.082947 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ec2121a8-2af8-41ac-913f-f3d8871655b6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:44.083663 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ec2121a8-2af8-41ac-913f-f3d8871655b6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:44.084114 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ec2121a8-2af8-41ac-913f-f3d8871655b6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:44.084524 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ec2121a8-2af8-41ac-913f-f3d8871655b6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:44.254390 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ec2121a8-2af8-41ac-913f-f3d8871655b6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:44.265166 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ec2121a8-2af8-41ac-913f-f3d8871655b6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1321 microversion: 2.1 time: 0.195781 Oct 11 12:00:44.265793 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 54/96] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:44 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1321 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:44.638063 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-10b9847b-56bb-4d46-83d2-22f725fd9121 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:44.639007 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-10b9847b-56bb-4d46-83d2-22f725fd9121 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:44.648913 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-10b9847b-56bb-4d46-83d2-22f725fd9121 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:44.649704 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-10b9847b-56bb-4d46-83d2-22f725fd9121 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:44.650431 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-10b9847b-56bb-4d46-83d2-22f725fd9121 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:44.651661 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-10b9847b-56bb-4d46-83d2-22f725fd9121 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:44.652759 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-10b9847b-56bb-4d46-83d2-22f725fd9121 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:44.653459 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-10b9847b-56bb-4d46-83d2-22f725fd9121 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:44.811940 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-10b9847b-56bb-4d46-83d2-22f725fd9121 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:44.828093 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-10b9847b-56bb-4d46-83d2-22f725fd9121 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1314 microversion: 2.1 time: 0.194271 Oct 11 12:00:44.829323 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-866dffea-62cc-49d6-bae3-a765b62c2abc tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:44.837705 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 43/97] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:44 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:00:44.837850 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-866dffea-62cc-49d6-bae3-a765b62c2abc tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:44.843024 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-866dffea-62cc-49d6-bae3-a765b62c2abc tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:44.843931 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-866dffea-62cc-49d6-bae3-a765b62c2abc tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:44.844786 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-866dffea-62cc-49d6-bae3-a765b62c2abc tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:44.846189 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-866dffea-62cc-49d6-bae3-a765b62c2abc tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:44.847475 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-866dffea-62cc-49d6-bae3-a765b62c2abc tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:44.848275 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-866dffea-62cc-49d6-bae3-a765b62c2abc tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:45.008313 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-866dffea-62cc-49d6-bae3-a765b62c2abc tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:45.018947 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-866dffea-62cc-49d6-bae3-a765b62c2abc tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1366 microversion: 2.1 time: 0.196347 Oct 11 12:00:45.019752 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 55/98] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:44 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:45.289703 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-ca70dd88-fd66-41dd-844a-f50f9fa89413 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:45.290376 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-ca70dd88-fd66-41dd-844a-f50f9fa89413 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:45.297284 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ca70dd88-fd66-41dd-844a-f50f9fa89413 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:45.297796 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ca70dd88-fd66-41dd-844a-f50f9fa89413 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:45.298231 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ca70dd88-fd66-41dd-844a-f50f9fa89413 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:45.298958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ca70dd88-fd66-41dd-844a-f50f9fa89413 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:45.299534 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ca70dd88-fd66-41dd-844a-f50f9fa89413 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:45.299949 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ca70dd88-fd66-41dd-844a-f50f9fa89413 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:45.475049 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-ca70dd88-fd66-41dd-844a-f50f9fa89413 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:45.484405 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-ca70dd88-fd66-41dd-844a-f50f9fa89413 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1321 microversion: 2.1 time: 0.198839 Oct 11 12:00:45.485008 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 44/99] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:45 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:45.867508 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f986de48-b67e-445f-a6a8-bded344405d3 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:45.868101 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f986de48-b67e-445f-a6a8-bded344405d3 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:45.874913 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f986de48-b67e-445f-a6a8-bded344405d3 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:45.875409 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f986de48-b67e-445f-a6a8-bded344405d3 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:45.875841 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f986de48-b67e-445f-a6a8-bded344405d3 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:45.876560 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f986de48-b67e-445f-a6a8-bded344405d3 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:45.877009 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f986de48-b67e-445f-a6a8-bded344405d3 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:45.877458 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f986de48-b67e-445f-a6a8-bded344405d3 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:46.047452 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-658cb8aa-8f18-4561-9450-4ebf4bdaf02a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:46.048667 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-658cb8aa-8f18-4561-9450-4ebf4bdaf02a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:46.059078 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-658cb8aa-8f18-4561-9450-4ebf4bdaf02a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:46.059768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-658cb8aa-8f18-4561-9450-4ebf4bdaf02a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:46.060336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-658cb8aa-8f18-4561-9450-4ebf4bdaf02a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:46.061159 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-658cb8aa-8f18-4561-9450-4ebf4bdaf02a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:46.061705 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-658cb8aa-8f18-4561-9450-4ebf4bdaf02a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:46.062349 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-658cb8aa-8f18-4561-9450-4ebf4bdaf02a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:46.068673 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f986de48-b67e-445f-a6a8-bded344405d3 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:46.081472 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f986de48-b67e-445f-a6a8-bded344405d3 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1314 microversion: 2.1 time: 0.217742 Oct 11 12:00:46.082402 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 56/100] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:45 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:46.251535 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-658cb8aa-8f18-4561-9450-4ebf4bdaf02a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:46.260891 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-658cb8aa-8f18-4561-9450-4ebf4bdaf02a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1366 microversion: 2.1 time: 0.219846 Oct 11 12:00:46.261700 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 45/101] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:46 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:00:46.511811 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-43107218-9988-40b6-a980-289a6fb57685 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:46.512436 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-43107218-9988-40b6-a980-289a6fb57685 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:46.515374 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=2 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:46.521840 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-43107218-9988-40b6-a980-289a6fb57685 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:46.522499 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-43107218-9988-40b6-a980-289a6fb57685 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:46.523054 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-43107218-9988-40b6-a980-289a6fb57685 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:46.523963 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-43107218-9988-40b6-a980-289a6fb57685 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:46.524561 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-43107218-9988-40b6-a980-289a6fb57685 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:46.525090 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-43107218-9988-40b6-a980-289a6fb57685 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:46.682006 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-43107218-9988-40b6-a980-289a6fb57685 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:46.688411 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=100 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:46.699561 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-43107218-9988-40b6-a980-289a6fb57685 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1321 microversion: 2.1 time: 0.192461 Oct 11 12:00:46.700576 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 57/102] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:46 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:00:47.106177 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-f3ed2abb-2d9f-4397-ba1d-5f02bfb4319c tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:47.107647 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-f3ed2abb-2d9f-4397-ba1d-5f02bfb4319c tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:47.115102 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f3ed2abb-2d9f-4397-ba1d-5f02bfb4319c tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:47.115625 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f3ed2abb-2d9f-4397-ba1d-5f02bfb4319c tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:47.116114 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f3ed2abb-2d9f-4397-ba1d-5f02bfb4319c tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:47.116853 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f3ed2abb-2d9f-4397-ba1d-5f02bfb4319c tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:47.117325 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f3ed2abb-2d9f-4397-ba1d-5f02bfb4319c tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:47.117925 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f3ed2abb-2d9f-4397-ba1d-5f02bfb4319c tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:47.295538 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-814a12b1-4753-4f4a-ac9f-d7fd5140d1fe tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:47.296693 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-814a12b1-4753-4f4a-ac9f-d7fd5140d1fe tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:47.309193 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-814a12b1-4753-4f4a-ac9f-d7fd5140d1fe tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:47.314420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-f3ed2abb-2d9f-4397-ba1d-5f02bfb4319c tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:47.320554 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-814a12b1-4753-4f4a-ac9f-d7fd5140d1fe tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:47.321298 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-814a12b1-4753-4f4a-ac9f-d7fd5140d1fe tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:47.322201 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-814a12b1-4753-4f4a-ac9f-d7fd5140d1fe tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:47.322765 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-814a12b1-4753-4f4a-ac9f-d7fd5140d1fe tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:47.323316 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-814a12b1-4753-4f4a-ac9f-d7fd5140d1fe tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:47.333791 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-f3ed2abb-2d9f-4397-ba1d-5f02bfb4319c tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1314 microversion: 2.1 time: 0.231268 Oct 11 12:00:47.335800 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 46/103] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:47 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:47.593327 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-814a12b1-4753-4f4a-ac9f-d7fd5140d1fe tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:47.604244 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-814a12b1-4753-4f4a-ac9f-d7fd5140d1fe tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1366 microversion: 2.1 time: 0.321245 Oct 11 12:00:47.605157 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 58/104] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:47 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1366 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:47.729415 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-52e71854-e3fc-42e4-9a73-d58b9c89f3a8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:47.731010 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-52e71854-e3fc-42e4-9a73-d58b9c89f3a8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:47.745841 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-52e71854-e3fc-42e4-9a73-d58b9c89f3a8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:47.748235 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-52e71854-e3fc-42e4-9a73-d58b9c89f3a8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:47.750603 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-52e71854-e3fc-42e4-9a73-d58b9c89f3a8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:47.752410 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-52e71854-e3fc-42e4-9a73-d58b9c89f3a8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:47.753505 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-52e71854-e3fc-42e4-9a73-d58b9c89f3a8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:47.754277 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-52e71854-e3fc-42e4-9a73-d58b9c89f3a8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:47.918060 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-6ef740b9-e29c-4146-86c0-80736c2a32e4 req-f23a6ed3-f389-4b60-9e74-5485b1472de7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac5dba27-8c1b-4760-ad6f-7ab81244e186", "tag": "4fee3639-3c5d-4ff4-9533-5ba1ecbb3bb5"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:00:47.929264 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-6ef740b9-e29c-4146-86c0-80736c2a32e4 req-f23a6ed3-f389-4b60-9e74-5485b1472de7 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:47.932678 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-6ef740b9-e29c-4146-86c0-80736c2a32e4 req-f23a6ed3-f389-4b60-9e74-5485b1472de7 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:47.933289 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-6ef740b9-e29c-4146-86c0-80736c2a32e4 req-f23a6ed3-f389-4b60-9e74-5485b1472de7 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:47.959978 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-6ef740b9-e29c-4146-86c0-80736c2a32e4 req-f23a6ed3-f389-4b60-9e74-5485b1472de7 service nova] Creating event network-changed:4fee3639-3c5d-4ff4-9533-5ba1ecbb3bb5 for instance ac5dba27-8c1b-4760-ad6f-7ab81244e186 on hv-cinder-82099 Oct 11 12:00:47.967681 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-6ef740b9-e29c-4146-86c0-80736c2a32e4 req-f23a6ed3-f389-4b60-9e74-5485b1472de7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053237 Oct 11 12:00:47.972243 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 59/105] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:00:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 12:00:48.377994 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6067d2f8-1800-4c98-9b12-8cb336312754 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:48.379519 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-6067d2f8-1800-4c98-9b12-8cb336312754 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:48.394391 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6067d2f8-1800-4c98-9b12-8cb336312754 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:48.395417 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6067d2f8-1800-4c98-9b12-8cb336312754 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:48.397891 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6067d2f8-1800-4c98-9b12-8cb336312754 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:48.400285 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6067d2f8-1800-4c98-9b12-8cb336312754 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:48.401328 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6067d2f8-1800-4c98-9b12-8cb336312754 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:48.402271 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6067d2f8-1800-4c98-9b12-8cb336312754 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:48.861351 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-52e71854-e3fc-42e4-9a73-d58b9c89f3a8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:48.878939 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell0:SELECT=2 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:48.898649 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-52e71854-e3fc-42e4-9a73-d58b9c89f3a8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1321 microversion: 2.1 time: 1.176711 Oct 11 12:00:48.899916 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 47/106] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:47 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1321 bytes in 1180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:48.909117 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6067d2f8-1800-4c98-9b12-8cb336312754 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:48.911811 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-37c2184b-9251-4ff4-98e0-ee2e6739b78e tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:48.918171 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-37c2184b-9251-4ff4-98e0-ee2e6739b78e tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:48.931913 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6067d2f8-1800-4c98-9b12-8cb336312754 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1314 microversion: 2.1 time: 0.558514 Oct 11 12:00:48.932502 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 60/107] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:48 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1314 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:00:48.951806 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-37c2184b-9251-4ff4-98e0-ee2e6739b78e tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:48.951806 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-37c2184b-9251-4ff4-98e0-ee2e6739b78e tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:48.951806 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-37c2184b-9251-4ff4-98e0-ee2e6739b78e tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:48.951806 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-37c2184b-9251-4ff4-98e0-ee2e6739b78e tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:48.952444 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-37c2184b-9251-4ff4-98e0-ee2e6739b78e tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:48.952567 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-37c2184b-9251-4ff4-98e0-ee2e6739b78e tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:49.116028 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e4e3d698-edd3-4d96-b476-302d3cb0c4a5 tempest-VolumesTestJSON-595916793 tempest-VolumesTestJSON-595916793-project] Calling method '.version_select at 0x7fd406ad2940>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:49.539076 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e4e3d698-edd3-4d96-b476-302d3cb0c4a5 tempest-VolumesTestJSON-595916793 tempest-VolumesTestJSON-595916793-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/c6e6a247-8aa8-4720-9e72-e3582dd9b7d9" status: 200 len: 351 microversion: 2.1 time: 0.426017 Oct 11 12:00:49.542451 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 61/108] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Oct 11 12:00:49 2022] GET /compute/v2.1/os-volumes/c6e6a247-8aa8-4720-9e72-e3582dd9b7d9 => generated 351 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 12:00:49.562034 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3cb9a8ee-cba1-45f0-9a58-cd2ef56eff71 tempest-VolumesTestJSON-595916793 tempest-VolumesTestJSON-595916793-project] Calling method '.version_select at 0x7fd406b3d9d0>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:49.755857 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-37c2184b-9251-4ff4-98e0-ee2e6739b78e tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:49.769664 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-37c2184b-9251-4ff4-98e0-ee2e6739b78e tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1366 microversion: 2.1 time: 0.867855 Oct 11 12:00:49.770664 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 48/109] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:48 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1366 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:49.819518 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-3cb9a8ee-cba1-45f0-9a58-cd2ef56eff71 tempest-VolumesTestJSON-595916793 tempest-VolumesTestJSON-595916793-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.264321 Oct 11 12:00:49.820457 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 62/110] 10.222.0.59 () {58 vars in 1134 bytes} [Tue Oct 11 12:00:49 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:49.836872 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-bbd5a544-5379-4ab4-950a-95ecc70ef900 tempest-VolumesTestJSON-595916793 tempest-VolumesTestJSON-595916793-project] Calling method '.version_select at 0x7fd406b0edc0>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:49.950111 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7c16c5fa-5492-4ddb-8be8-916e3ceb7615 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:49.950840 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7c16c5fa-5492-4ddb-8be8-916e3ceb7615 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:49.960741 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c16c5fa-5492-4ddb-8be8-916e3ceb7615 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:49.961585 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c16c5fa-5492-4ddb-8be8-916e3ceb7615 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:49.962227 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c16c5fa-5492-4ddb-8be8-916e3ceb7615 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:49.963542 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c16c5fa-5492-4ddb-8be8-916e3ceb7615 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:49.964207 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c16c5fa-5492-4ddb-8be8-916e3ceb7615 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:49.964809 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c16c5fa-5492-4ddb-8be8-916e3ceb7615 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:49.977024 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-bbd5a544-5379-4ab4-950a-95ecc70ef900 tempest-VolumesTestJSON-595916793 tempest-VolumesTestJSON-595916793-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.145025 Oct 11 12:00:49.978041 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 49/111] 10.222.0.59 () {58 vars in 1149 bytes} [Tue Oct 11 12:00:49 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:00:49.998585 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-ad3d815d-656c-441c-af18-c492ee4b5c6e tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:49.999796 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-ad3d815d-656c-441c-af18-c492ee4b5c6e tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:50.008392 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ad3d815d-656c-441c-af18-c492ee4b5c6e tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:50.008877 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ad3d815d-656c-441c-af18-c492ee4b5c6e tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:50.009341 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ad3d815d-656c-441c-af18-c492ee4b5c6e tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:50.010134 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ad3d815d-656c-441c-af18-c492ee4b5c6e tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:50.010675 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ad3d815d-656c-441c-af18-c492ee4b5c6e tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:50.011275 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ad3d815d-656c-441c-af18-c492ee4b5c6e tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:50.173238 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7c16c5fa-5492-4ddb-8be8-916e3ceb7615 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:50.200882 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7c16c5fa-5492-4ddb-8be8-916e3ceb7615 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1321 microversion: 2.1 time: 0.254519 Oct 11 12:00:50.215828 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 63/112] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:49 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1321 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:50.242241 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-cc92590b-f62f-4219-8db3-27f2ba7dad0e tempest-VolumesTestJSON-595916793 tempest-VolumesTestJSON-595916793-project] Calling method '.version_select at 0x7fd406b2b4c0>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:50.260351 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-ad3d815d-656c-441c-af18-c492ee4b5c6e tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:50.270736 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-ad3d815d-656c-441c-af18-c492ee4b5c6e tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1314 microversion: 2.1 time: 0.291128 Oct 11 12:00:50.272169 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 50/113] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:49 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:50.348881 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-cc92590b-f62f-4219-8db3-27f2ba7dad0e tempest-VolumesTestJSON-595916793 tempest-VolumesTestJSON-595916793-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.131406 Oct 11 12:00:50.349600 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 64/114] 10.222.0.59 () {58 vars in 1134 bytes} [Tue Oct 11 12:00:50 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:50.363616 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-e092592b-8f9e-4924-a808-77cbf3caf910 tempest-VolumesTestJSON-595916793 tempest-VolumesTestJSON-595916793-project] Calling method '.version_select at 0x7fd406ab3280>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:50.468485 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-e092592b-8f9e-4924-a808-77cbf3caf910 tempest-VolumesTestJSON-595916793 tempest-VolumesTestJSON-595916793-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.109403 Oct 11 12:00:50.469061 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 51/115] 10.222.0.59 () {58 vars in 1167 bytes} [Tue Oct 11 12:00:50 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:00:50.487489 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-81524fca-7a4b-4139-be1c-9825fa48302a tempest-VolumesTestJSON-595916793 tempest-VolumesTestJSON-595916793-project] Calling method '.version_select at 0x7fd406ad2dc0>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:50.650777 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-81524fca-7a4b-4139-be1c-9825fa48302a tempest-VolumesTestJSON-595916793 tempest-VolumesTestJSON-595916793-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.170453 Oct 11 12:00:50.651783 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 65/116] 10.222.0.59 () {58 vars in 1170 bytes} [Tue Oct 11 12:00:50 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:00:50.667004 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-b5b67b3b-342c-480e-929c-2a21b6b98b5a tempest-VolumesTestJSON-595916793 tempest-VolumesTestJSON-595916793-project] Calling method '.version_select at 0x7fd406a88e50>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:50.774055 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-b5b67b3b-342c-480e-929c-2a21b6b98b5a tempest-VolumesTestJSON-595916793 tempest-VolumesTestJSON-595916793-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.111066 Oct 11 12:00:50.775094 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 52/117] 10.222.0.59 () {58 vars in 1155 bytes} [Tue Oct 11 12:00:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:50.792887 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c3ffcac0-ed52-4618-b1bc-d3ba4ffe23c6 tempest-VolumesTestJSON-595916793 tempest-VolumesTestJSON-595916793-project] Calling method '.version_select at 0x7fd406ad2670>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:50.804488 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-54de9358-065c-4ad8-8d4b-9aeb1e72fc71 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:50.805108 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-54de9358-065c-4ad8-8d4b-9aeb1e72fc71 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:50.816233 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-54de9358-065c-4ad8-8d4b-9aeb1e72fc71 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:50.817231 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-54de9358-065c-4ad8-8d4b-9aeb1e72fc71 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:50.818030 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-54de9358-065c-4ad8-8d4b-9aeb1e72fc71 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:50.819354 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-54de9358-065c-4ad8-8d4b-9aeb1e72fc71 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:50.820062 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-54de9358-065c-4ad8-8d4b-9aeb1e72fc71 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:50.820632 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-54de9358-065c-4ad8-8d4b-9aeb1e72fc71 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:50.910368 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c3ffcac0-ed52-4618-b1bc-d3ba4ffe23c6 tempest-VolumesTestJSON-595916793 tempest-VolumesTestJSON-595916793-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.123102 Oct 11 12:00:50.911270 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 66/118] 10.222.0.59 () {58 vars in 1188 bytes} [Tue Oct 11 12:00:50 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:00:50.928381 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e13cbd61-2b00-40af-a245-ccfe02b094cd tempest-VolumesTestJSON-595916793 tempest-VolumesTestJSON-595916793-project] Calling method '.version_select at 0x7fd406b2b280>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:51.046650 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-54de9358-065c-4ad8-8d4b-9aeb1e72fc71 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:51.063623 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-54de9358-065c-4ad8-8d4b-9aeb1e72fc71 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1366 microversion: 2.1 time: 0.263582 Oct 11 12:00:51.076950 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 53/119] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:50 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:51.252828 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-ac22b701-6aa0-495f-bd59-876dca471696 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:51.253595 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-ac22b701-6aa0-495f-bd59-876dca471696 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:51.255418 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e13cbd61-2b00-40af-a245-ccfe02b094cd tempest-VolumesTestJSON-595916793 tempest-VolumesTestJSON-595916793-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.331901 Oct 11 12:00:51.278058 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 67/120] 10.222.0.59 () {58 vars in 1155 bytes} [Tue Oct 11 12:00:50 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:51.281667 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ac22b701-6aa0-495f-bd59-876dca471696 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:51.283242 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ac22b701-6aa0-495f-bd59-876dca471696 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:51.285758 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ac22b701-6aa0-495f-bd59-876dca471696 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:51.287403 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ac22b701-6aa0-495f-bd59-876dca471696 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:51.291791 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ac22b701-6aa0-495f-bd59-876dca471696 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:51.295550 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ac22b701-6aa0-495f-bd59-876dca471696 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:51.325483 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e11c4383-7088-4ff8-81dc-5d256450ea1e tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:51.328701 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e11c4383-7088-4ff8-81dc-5d256450ea1e tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:51.354515 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e11c4383-7088-4ff8-81dc-5d256450ea1e tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:51.360593 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e11c4383-7088-4ff8-81dc-5d256450ea1e tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:51.367832 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e11c4383-7088-4ff8-81dc-5d256450ea1e tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:51.369234 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e11c4383-7088-4ff8-81dc-5d256450ea1e tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:51.374146 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e11c4383-7088-4ff8-81dc-5d256450ea1e tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:51.378973 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e11c4383-7088-4ff8-81dc-5d256450ea1e tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:51.757811 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-ac22b701-6aa0-495f-bd59-876dca471696 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:51.781140 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-ac22b701-6aa0-495f-bd59-876dca471696 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1321 microversion: 2.1 time: 0.532333 Oct 11 12:00:51.782980 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 54/121] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:51 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1321 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:00:51.863887 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e11c4383-7088-4ff8-81dc-5d256450ea1e tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:51.885195 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e11c4383-7088-4ff8-81dc-5d256450ea1e tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1314 microversion: 2.1 time: 0.573767 Oct 11 12:00:51.900375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 68/122] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:51 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1314 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:52.100493 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-06ee72b9-9362-42fe-a21b-dbcbe706184a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:52.102736 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-06ee72b9-9362-42fe-a21b-dbcbe706184a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:52.113222 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-06ee72b9-9362-42fe-a21b-dbcbe706184a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:52.114105 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-06ee72b9-9362-42fe-a21b-dbcbe706184a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:52.115326 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-06ee72b9-9362-42fe-a21b-dbcbe706184a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:52.116896 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-06ee72b9-9362-42fe-a21b-dbcbe706184a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:52.118126 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-06ee72b9-9362-42fe-a21b-dbcbe706184a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:52.119177 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-06ee72b9-9362-42fe-a21b-dbcbe706184a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:52.377964 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-06ee72b9-9362-42fe-a21b-dbcbe706184a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:52.393192 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-06ee72b9-9362-42fe-a21b-dbcbe706184a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1366 microversion: 2.1 time: 0.299529 Oct 11 12:00:52.394259 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 55/123] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:52 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1366 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:52.826789 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0ac9f616-32cd-4553-9ec1-68c3359baee1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:52.828405 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0ac9f616-32cd-4553-9ec1-68c3359baee1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:52.841366 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0ac9f616-32cd-4553-9ec1-68c3359baee1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:52.842897 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0ac9f616-32cd-4553-9ec1-68c3359baee1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:52.843699 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0ac9f616-32cd-4553-9ec1-68c3359baee1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:52.845255 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0ac9f616-32cd-4553-9ec1-68c3359baee1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:52.852958 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0ac9f616-32cd-4553-9ec1-68c3359baee1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:52.854297 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0ac9f616-32cd-4553-9ec1-68c3359baee1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:52.938614 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-d8860bfa-ba72-47d7-8bfe-8197d4a4509d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:52.941668 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-d8860bfa-ba72-47d7-8bfe-8197d4a4509d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:52.968819 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d8860bfa-ba72-47d7-8bfe-8197d4a4509d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:52.974402 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d8860bfa-ba72-47d7-8bfe-8197d4a4509d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:52.980145 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d8860bfa-ba72-47d7-8bfe-8197d4a4509d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:52.981541 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d8860bfa-ba72-47d7-8bfe-8197d4a4509d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:52.984341 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d8860bfa-ba72-47d7-8bfe-8197d4a4509d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:52.984489 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d8860bfa-ba72-47d7-8bfe-8197d4a4509d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:53.036366 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=100 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:00:53.215931 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0ac9f616-32cd-4553-9ec1-68c3359baee1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:53.235301 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0ac9f616-32cd-4553-9ec1-68c3359baee1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1321 microversion: 2.1 time: 0.415905 Oct 11 12:00:53.251207 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 69/124] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:52 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1321 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:53.417118 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-d8860bfa-ba72-47d7-8bfe-8197d4a4509d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:53.429001 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e8a1e0e2-63b9-47c7-bbe9-23e513aead81 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:53.434241 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e8a1e0e2-63b9-47c7-bbe9-23e513aead81 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:53.441074 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-d8860bfa-ba72-47d7-8bfe-8197d4a4509d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1314 microversion: 2.1 time: 0.517452 Oct 11 12:00:53.442675 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 56/125] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:52 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1314 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:53.455599 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e8a1e0e2-63b9-47c7-bbe9-23e513aead81 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:53.456299 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e8a1e0e2-63b9-47c7-bbe9-23e513aead81 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:53.456888 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e8a1e0e2-63b9-47c7-bbe9-23e513aead81 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:53.458001 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e8a1e0e2-63b9-47c7-bbe9-23e513aead81 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:53.458811 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e8a1e0e2-63b9-47c7-bbe9-23e513aead81 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:53.459375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e8a1e0e2-63b9-47c7-bbe9-23e513aead81 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:53.768426 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e8a1e0e2-63b9-47c7-bbe9-23e513aead81 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:53.778228 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e8a1e0e2-63b9-47c7-bbe9-23e513aead81 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1366 microversion: 2.1 time: 0.359552 Oct 11 12:00:53.779580 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 70/126] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:53 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1366 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:54.281771 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-01c9ccb2-42db-4461-88a1-bd386e55b88d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:54.283349 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-01c9ccb2-42db-4461-88a1-bd386e55b88d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:54.296048 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-01c9ccb2-42db-4461-88a1-bd386e55b88d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:54.296908 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-01c9ccb2-42db-4461-88a1-bd386e55b88d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:54.297670 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-01c9ccb2-42db-4461-88a1-bd386e55b88d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:54.299284 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-01c9ccb2-42db-4461-88a1-bd386e55b88d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:54.300961 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-01c9ccb2-42db-4461-88a1-bd386e55b88d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:54.302142 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-01c9ccb2-42db-4461-88a1-bd386e55b88d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:54.485084 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b5129956-d8f3-4b6e-b199-5b28235cbb46 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:54.485800 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-b5129956-d8f3-4b6e-b199-5b28235cbb46 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:54.499038 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b5129956-d8f3-4b6e-b199-5b28235cbb46 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:54.499537 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b5129956-d8f3-4b6e-b199-5b28235cbb46 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:54.500136 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b5129956-d8f3-4b6e-b199-5b28235cbb46 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:54.501001 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b5129956-d8f3-4b6e-b199-5b28235cbb46 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:54.502467 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b5129956-d8f3-4b6e-b199-5b28235cbb46 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:54.504242 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b5129956-d8f3-4b6e-b199-5b28235cbb46 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:54.738790 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-01c9ccb2-42db-4461-88a1-bd386e55b88d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:54.759079 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-01c9ccb2-42db-4461-88a1-bd386e55b88d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1321 microversion: 2.1 time: 0.484078 Oct 11 12:00:54.778641 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 57/127] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:54 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1321 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:54.820856 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-a0f21aca-b42e-4caf-b709-78ef2e6f13eb tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:54.821497 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-a0f21aca-b42e-4caf-b709-78ef2e6f13eb tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:54.833512 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a0f21aca-b42e-4caf-b709-78ef2e6f13eb tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:54.834018 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a0f21aca-b42e-4caf-b709-78ef2e6f13eb tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:54.834455 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a0f21aca-b42e-4caf-b709-78ef2e6f13eb tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:54.835209 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a0f21aca-b42e-4caf-b709-78ef2e6f13eb tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:54.835660 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a0f21aca-b42e-4caf-b709-78ef2e6f13eb tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:54.836076 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a0f21aca-b42e-4caf-b709-78ef2e6f13eb tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:55.207770 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-b5129956-d8f3-4b6e-b199-5b28235cbb46 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:55.234704 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b5129956-d8f3-4b6e-b199-5b28235cbb46 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1314 microversion: 2.1 time: 0.753440 Oct 11 12:00:55.236357 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 71/128] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:54 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1314 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:55.807463 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2aa4baa6-ff36-46a3-bebb-8e53a5006446 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:55.813631 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2aa4baa6-ff36-46a3-bebb-8e53a5006446 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:55.849367 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2aa4baa6-ff36-46a3-bebb-8e53a5006446 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:55.853697 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2aa4baa6-ff36-46a3-bebb-8e53a5006446 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:55.857221 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2aa4baa6-ff36-46a3-bebb-8e53a5006446 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:55.861242 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2aa4baa6-ff36-46a3-bebb-8e53a5006446 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:55.870741 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2aa4baa6-ff36-46a3-bebb-8e53a5006446 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:55.872391 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2aa4baa6-ff36-46a3-bebb-8e53a5006446 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:55.876041 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-a0f21aca-b42e-4caf-b709-78ef2e6f13eb tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:55.905938 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-a0f21aca-b42e-4caf-b709-78ef2e6f13eb tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1366 microversion: 2.1 time: 1.090788 Oct 11 12:00:55.914128 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 58/129] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:54 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1366 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:56.269217 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-94f40984-5e3a-42d7-8307-46baaaae9922 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:56.277813 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-94f40984-5e3a-42d7-8307-46baaaae9922 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:56.312070 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-94f40984-5e3a-42d7-8307-46baaaae9922 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:56.312556 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-94f40984-5e3a-42d7-8307-46baaaae9922 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:56.312993 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-94f40984-5e3a-42d7-8307-46baaaae9922 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:56.313717 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-94f40984-5e3a-42d7-8307-46baaaae9922 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:56.314173 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-94f40984-5e3a-42d7-8307-46baaaae9922 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:56.332024 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-94f40984-5e3a-42d7-8307-46baaaae9922 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:56.334507 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2aa4baa6-ff36-46a3-bebb-8e53a5006446 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:56.412529 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2aa4baa6-ff36-46a3-bebb-8e53a5006446 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1321 microversion: 2.1 time: 0.611911 Oct 11 12:00:56.434431 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 72/130] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:55 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1321 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:56.938226 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-84993550-2c4e-4baa-9d17-3ebe8dd04d69 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:56.939607 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-84993550-2c4e-4baa-9d17-3ebe8dd04d69 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:56.959066 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-84993550-2c4e-4baa-9d17-3ebe8dd04d69 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:56.960046 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-84993550-2c4e-4baa-9d17-3ebe8dd04d69 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:56.961487 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-84993550-2c4e-4baa-9d17-3ebe8dd04d69 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:56.964426 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-84993550-2c4e-4baa-9d17-3ebe8dd04d69 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:56.967367 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-84993550-2c4e-4baa-9d17-3ebe8dd04d69 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:56.970476 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-84993550-2c4e-4baa-9d17-3ebe8dd04d69 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:56.971484 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-94f40984-5e3a-42d7-8307-46baaaae9922 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:56.985110 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-94f40984-5e3a-42d7-8307-46baaaae9922 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1314 microversion: 2.1 time: 0.722305 Oct 11 12:00:56.988814 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 59/131] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:56 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1314 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:57.275299 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-84993550-2c4e-4baa-9d17-3ebe8dd04d69 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:57.290464 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-84993550-2c4e-4baa-9d17-3ebe8dd04d69 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1366 microversion: 2.1 time: 0.353495 Oct 11 12:00:57.294446 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 73/132] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:56 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1366 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:57.453263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c1d9ee1e-7196-468d-80dc-7bd0956b1647 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:57.455375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c1d9ee1e-7196-468d-80dc-7bd0956b1647 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:57.463175 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c1d9ee1e-7196-468d-80dc-7bd0956b1647 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:57.463819 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c1d9ee1e-7196-468d-80dc-7bd0956b1647 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:57.464873 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c1d9ee1e-7196-468d-80dc-7bd0956b1647 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:57.465842 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c1d9ee1e-7196-468d-80dc-7bd0956b1647 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:57.466372 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c1d9ee1e-7196-468d-80dc-7bd0956b1647 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:57.466886 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c1d9ee1e-7196-468d-80dc-7bd0956b1647 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:57.610033 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-97bd1719-d5d9-4c6c-9933-0f2da1516000 req-87d39a0f-ec1d-4530-95a0-68f205bb74a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac5dba27-8c1b-4760-ad6f-7ab81244e186", "name": "network-vif-plugged", "status": "completed", "tag": "4fee3639-3c5d-4ff4-9533-5ba1ecbb3bb5"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:00:57.640127 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-97bd1719-d5d9-4c6c-9933-0f2da1516000 req-87d39a0f-ec1d-4530-95a0-68f205bb74a7 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:57.640904 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-97bd1719-d5d9-4c6c-9933-0f2da1516000 req-87d39a0f-ec1d-4530-95a0-68f205bb74a7 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:57.643239 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-97bd1719-d5d9-4c6c-9933-0f2da1516000 req-87d39a0f-ec1d-4530-95a0-68f205bb74a7 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:57.667040 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-97bd1719-d5d9-4c6c-9933-0f2da1516000 req-87d39a0f-ec1d-4530-95a0-68f205bb74a7 service nova] Creating event network-vif-plugged:4fee3639-3c5d-4ff4-9533-5ba1ecbb3bb5 for instance ac5dba27-8c1b-4760-ad6f-7ab81244e186 on hv-cinder-82099 Oct 11 12:00:57.675094 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-97bd1719-d5d9-4c6c-9933-0f2da1516000 req-87d39a0f-ec1d-4530-95a0-68f205bb74a7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.294656 Oct 11 12:00:57.681306 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 60/133] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:00:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:00:57.806784 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c1d9ee1e-7196-468d-80dc-7bd0956b1647 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:57.816283 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c1d9ee1e-7196-468d-80dc-7bd0956b1647 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1321 microversion: 2.1 time: 0.375820 Oct 11 12:00:57.817864 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 74/134] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:57 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1321 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:00:58.024293 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-bfafd61f-363e-42e4-a6c9-907ecb6f9b82 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:58.024993 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-bfafd61f-363e-42e4-a6c9-907ecb6f9b82 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:58.049998 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bfafd61f-363e-42e4-a6c9-907ecb6f9b82 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:58.051538 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bfafd61f-363e-42e4-a6c9-907ecb6f9b82 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:58.053239 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bfafd61f-363e-42e4-a6c9-907ecb6f9b82 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:58.054678 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bfafd61f-363e-42e4-a6c9-907ecb6f9b82 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:58.061088 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bfafd61f-363e-42e4-a6c9-907ecb6f9b82 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:58.065323 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bfafd61f-363e-42e4-a6c9-907ecb6f9b82 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:58.260711 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-bfafd61f-363e-42e4-a6c9-907ecb6f9b82 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:58.270784 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-bfafd61f-363e-42e4-a6c9-907ecb6f9b82 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1314 microversion: 2.1 time: 0.251013 Oct 11 12:00:58.271737 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 61/135] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:58 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:58.334317 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5f54efab-cc6b-464c-a0a7-c2fec4866422 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:58.337226 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-5f54efab-cc6b-464c-a0a7-c2fec4866422 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:58.353342 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5f54efab-cc6b-464c-a0a7-c2fec4866422 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:58.354719 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5f54efab-cc6b-464c-a0a7-c2fec4866422 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:58.355432 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5f54efab-cc6b-464c-a0a7-c2fec4866422 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:58.356394 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5f54efab-cc6b-464c-a0a7-c2fec4866422 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:58.357062 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5f54efab-cc6b-464c-a0a7-c2fec4866422 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:58.357787 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5f54efab-cc6b-464c-a0a7-c2fec4866422 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:58.755106 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5f54efab-cc6b-464c-a0a7-c2fec4866422 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:58.772054 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5f54efab-cc6b-464c-a0a7-c2fec4866422 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1366 microversion: 2.1 time: 0.445158 Oct 11 12:00:58.779016 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 75/136] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:58 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1366 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:00:58.871306 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-1fd3f24e-4ae5-4422-a191-1f25ab86cdee tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:58.872468 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-1fd3f24e-4ae5-4422-a191-1f25ab86cdee tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:58.880361 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1fd3f24e-4ae5-4422-a191-1f25ab86cdee tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:58.881077 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1fd3f24e-4ae5-4422-a191-1f25ab86cdee tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:58.881680 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1fd3f24e-4ae5-4422-a191-1f25ab86cdee tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:58.882810 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1fd3f24e-4ae5-4422-a191-1f25ab86cdee tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:58.883553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1fd3f24e-4ae5-4422-a191-1f25ab86cdee tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:58.884253 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1fd3f24e-4ae5-4422-a191-1f25ab86cdee tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:59.196780 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-1fd3f24e-4ae5-4422-a191-1f25ab86cdee tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:59.210311 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-1fd3f24e-4ae5-4422-a191-1f25ab86cdee tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1321 microversion: 2.1 time: 0.345354 Oct 11 12:00:59.211019 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 62/137] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:58 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1321 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:00:59.307970 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2730199d-2340-4875-b27a-d49cbac81d9b tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:59.308716 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2730199d-2340-4875-b27a-d49cbac81d9b tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:59.325472 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2730199d-2340-4875-b27a-d49cbac81d9b tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:59.326041 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2730199d-2340-4875-b27a-d49cbac81d9b tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:59.326480 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2730199d-2340-4875-b27a-d49cbac81d9b tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:59.331524 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2730199d-2340-4875-b27a-d49cbac81d9b tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:59.332018 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2730199d-2340-4875-b27a-d49cbac81d9b tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:59.332448 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2730199d-2340-4875-b27a-d49cbac81d9b tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:59.631391 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2730199d-2340-4875-b27a-d49cbac81d9b tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:00:59.645628 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2730199d-2340-4875-b27a-d49cbac81d9b tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1314 microversion: 2.1 time: 0.342185 Oct 11 12:00:59.646956 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 76/138] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:59 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:00:59.818715 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-052d12ab-6baa-4fb7-a55f-76516487a188 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:00:59.819875 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-052d12ab-6baa-4fb7-a55f-76516487a188 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:00:59.828350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-052d12ab-6baa-4fb7-a55f-76516487a188 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:59.831135 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-052d12ab-6baa-4fb7-a55f-76516487a188 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:59.832870 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-052d12ab-6baa-4fb7-a55f-76516487a188 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:00:59.834019 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-052d12ab-6baa-4fb7-a55f-76516487a188 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:00:59.835608 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-052d12ab-6baa-4fb7-a55f-76516487a188 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:00:59.840418 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-052d12ab-6baa-4fb7-a55f-76516487a188 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:00.086909 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-052d12ab-6baa-4fb7-a55f-76516487a188 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:00.105065 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-052d12ab-6baa-4fb7-a55f-76516487a188 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1366 microversion: 2.1 time: 0.289892 Oct 11 12:01:00.115049 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 63/139] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:00:59 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:00.261414 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-68451dce-2dff-425c-b4d0-4c50537d89bc tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:00.262584 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-68451dce-2dff-425c-b4d0-4c50537d89bc tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:00.273520 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-68451dce-2dff-425c-b4d0-4c50537d89bc tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:00.275869 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-68451dce-2dff-425c-b4d0-4c50537d89bc tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:00.278304 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-68451dce-2dff-425c-b4d0-4c50537d89bc tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:00.281083 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-68451dce-2dff-425c-b4d0-4c50537d89bc tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:00.282643 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-68451dce-2dff-425c-b4d0-4c50537d89bc tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:00.284524 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-68451dce-2dff-425c-b4d0-4c50537d89bc tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:00.679852 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-68451dce-2dff-425c-b4d0-4c50537d89bc tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:00.684910 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-5cedc68a-0ca8-4233-b4f0-6aed07099cfd tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:00.685936 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-5cedc68a-0ca8-4233-b4f0-6aed07099cfd tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:00.734809 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5cedc68a-0ca8-4233-b4f0-6aed07099cfd tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:00.738684 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5cedc68a-0ca8-4233-b4f0-6aed07099cfd tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:00.739380 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5cedc68a-0ca8-4233-b4f0-6aed07099cfd tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:00.739870 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-68451dce-2dff-425c-b4d0-4c50537d89bc tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1321 microversion: 2.1 time: 0.464664 Oct 11 12:01:00.740988 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5cedc68a-0ca8-4233-b4f0-6aed07099cfd tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:00.742889 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5cedc68a-0ca8-4233-b4f0-6aed07099cfd tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:00.743864 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 77/140] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:00 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1321 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:01:00.744102 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5cedc68a-0ca8-4233-b4f0-6aed07099cfd tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:00.783479 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-2c237656-286a-4639-98bf-d3b479a6b1ac req-c30c04f2-4f70-4ddb-9d88-40c5c818916c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70722a52-e702-4e13-a49a-6f2c1161ae35", "name": "network-vif-plugged", "status": "completed", "tag": "615246f6-a650-4d01-8f0c-205bc002fd3d"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:01:00.846329 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-2c237656-286a-4639-98bf-d3b479a6b1ac req-c30c04f2-4f70-4ddb-9d88-40c5c818916c service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:00.848210 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-2c237656-286a-4639-98bf-d3b479a6b1ac req-c30c04f2-4f70-4ddb-9d88-40c5c818916c service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:00.849309 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-2c237656-286a-4639-98bf-d3b479a6b1ac req-c30c04f2-4f70-4ddb-9d88-40c5c818916c service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:00.905993 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-2c237656-286a-4639-98bf-d3b479a6b1ac req-c30c04f2-4f70-4ddb-9d88-40c5c818916c service nova] Creating event network-vif-plugged:615246f6-a650-4d01-8f0c-205bc002fd3d for instance 70722a52-e702-4e13-a49a-6f2c1161ae35 on hv-cinder-82099 Oct 11 12:01:00.927120 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-2c237656-286a-4639-98bf-d3b479a6b1ac req-c30c04f2-4f70-4ddb-9d88-40c5c818916c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180524 Oct 11 12:01:00.933443 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 78/141] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:01:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:01:01.159343 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b3093cbe-bd85-4623-b8de-539ea713c30d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:01.161641 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-b3093cbe-bd85-4623-b8de-539ea713c30d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:01.189153 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b3093cbe-bd85-4623-b8de-539ea713c30d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:01.195079 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b3093cbe-bd85-4623-b8de-539ea713c30d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:01.196772 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b3093cbe-bd85-4623-b8de-539ea713c30d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:01.198440 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b3093cbe-bd85-4623-b8de-539ea713c30d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:01.199602 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b3093cbe-bd85-4623-b8de-539ea713c30d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:01.200558 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b3093cbe-bd85-4623-b8de-539ea713c30d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:01.386768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-5cedc68a-0ca8-4233-b4f0-6aed07099cfd tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:01.396473 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-5cedc68a-0ca8-4233-b4f0-6aed07099cfd tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1314 microversion: 2.1 time: 0.716383 Oct 11 12:01:01.397969 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 64/142] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:00 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1314 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:01.691317 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-b3093cbe-bd85-4623-b8de-539ea713c30d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:01.706403 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b3093cbe-bd85-4623-b8de-539ea713c30d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1366 microversion: 2.1 time: 0.559442 Oct 11 12:01:01.720127 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 79/143] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:01 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1366 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:01.792470 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-63060301-5c28-4be6-b0af-d8715d9a5229 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:01.793552 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-63060301-5c28-4be6-b0af-d8715d9a5229 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:01.797095 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_api:SELECT=64 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:01.807016 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-63060301-5c28-4be6-b0af-d8715d9a5229 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:01.807882 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-63060301-5c28-4be6-b0af-d8715d9a5229 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:01.809058 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-63060301-5c28-4be6-b0af-d8715d9a5229 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:01.810753 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-63060301-5c28-4be6-b0af-d8715d9a5229 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:01.811578 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-63060301-5c28-4be6-b0af-d8715d9a5229 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:01.812340 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-63060301-5c28-4be6-b0af-d8715d9a5229 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:02.107749 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-63060301-5c28-4be6-b0af-d8715d9a5229 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:02.120413 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-63060301-5c28-4be6-b0af-d8715d9a5229 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1321 microversion: 2.1 time: 0.338037 Oct 11 12:01:02.121911 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 65/144] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:01 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1321 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:02.420388 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e96f3362-b445-4b19-baea-a90f07d8fce5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:02.421258 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e96f3362-b445-4b19-baea-a90f07d8fce5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:02.429500 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e96f3362-b445-4b19-baea-a90f07d8fce5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:02.430151 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e96f3362-b445-4b19-baea-a90f07d8fce5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:02.430718 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e96f3362-b445-4b19-baea-a90f07d8fce5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:02.431687 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e96f3362-b445-4b19-baea-a90f07d8fce5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:02.432252 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e96f3362-b445-4b19-baea-a90f07d8fce5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:02.432780 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e96f3362-b445-4b19-baea-a90f07d8fce5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:02.629706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e96f3362-b445-4b19-baea-a90f07d8fce5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:02.639295 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e96f3362-b445-4b19-baea-a90f07d8fce5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1314 microversion: 2.1 time: 0.223023 Oct 11 12:01:02.640037 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 80/145] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:02 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:02.750835 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-c9962f2b-78b3-4fe7-b3b0-2e7668f97f74 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:02.752159 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-c9962f2b-78b3-4fe7-b3b0-2e7668f97f74 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:02.764280 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c9962f2b-78b3-4fe7-b3b0-2e7668f97f74 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:02.765326 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c9962f2b-78b3-4fe7-b3b0-2e7668f97f74 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:02.766004 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c9962f2b-78b3-4fe7-b3b0-2e7668f97f74 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:02.767710 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c9962f2b-78b3-4fe7-b3b0-2e7668f97f74 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:02.768423 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c9962f2b-78b3-4fe7-b3b0-2e7668f97f74 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:02.769681 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c9962f2b-78b3-4fe7-b3b0-2e7668f97f74 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:02.983718 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-c9962f2b-78b3-4fe7-b3b0-2e7668f97f74 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:02.992161 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-c9962f2b-78b3-4fe7-b3b0-2e7668f97f74 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1366 microversion: 2.1 time: 0.248221 Oct 11 12:01:02.992764 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 66/146] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:02 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1366 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:01:03.160014 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-4f6be795-637b-45a1-945d-4dd6e3e77cb8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:03.160620 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-4f6be795-637b-45a1-945d-4dd6e3e77cb8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:03.170610 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f6be795-637b-45a1-945d-4dd6e3e77cb8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:03.171484 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f6be795-637b-45a1-945d-4dd6e3e77cb8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:03.172291 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f6be795-637b-45a1-945d-4dd6e3e77cb8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:03.173399 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f6be795-637b-45a1-945d-4dd6e3e77cb8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:03.174114 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f6be795-637b-45a1-945d-4dd6e3e77cb8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:03.174691 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f6be795-637b-45a1-945d-4dd6e3e77cb8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:03.393332 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-4f6be795-637b-45a1-945d-4dd6e3e77cb8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:03.399885 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=100 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:03.412204 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-4f6be795-637b-45a1-945d-4dd6e3e77cb8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1321 microversion: 2.1 time: 0.255808 Oct 11 12:01:03.413472 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 81/147] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:03 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:01:03.668380 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-be7aeac7-579a-486c-b693-901ed64a08f1 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:03.669647 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-be7aeac7-579a-486c-b693-901ed64a08f1 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:03.681744 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-be7aeac7-579a-486c-b693-901ed64a08f1 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:03.682625 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-be7aeac7-579a-486c-b693-901ed64a08f1 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:03.683399 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-be7aeac7-579a-486c-b693-901ed64a08f1 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:03.684710 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-be7aeac7-579a-486c-b693-901ed64a08f1 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:03.685557 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-be7aeac7-579a-486c-b693-901ed64a08f1 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:03.686294 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-be7aeac7-579a-486c-b693-901ed64a08f1 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:04.022786 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6c480409-46c9-4836-992f-f9d947329d3e tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:04.024003 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-6c480409-46c9-4836-992f-f9d947329d3e tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:04.032101 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6c480409-46c9-4836-992f-f9d947329d3e tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:04.032833 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6c480409-46c9-4836-992f-f9d947329d3e tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:04.033471 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6c480409-46c9-4836-992f-f9d947329d3e tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:04.034346 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6c480409-46c9-4836-992f-f9d947329d3e tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:04.035053 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6c480409-46c9-4836-992f-f9d947329d3e tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:04.035909 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6c480409-46c9-4836-992f-f9d947329d3e tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:04.045526 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-be7aeac7-579a-486c-b693-901ed64a08f1 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:04.056009 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-be7aeac7-579a-486c-b693-901ed64a08f1 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1314 microversion: 2.1 time: 0.394957 Oct 11 12:01:04.059169 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 67/148] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:03 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1314 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:01:04.303494 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6c480409-46c9-4836-992f-f9d947329d3e tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:04.316906 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6c480409-46c9-4836-992f-f9d947329d3e tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1366 microversion: 2.1 time: 0.302621 Oct 11 12:01:04.317821 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 82/149] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:04 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:04.448587 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-1b9ef134-50d7-48c3-a2b9-e96bc8bf055a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:04.449553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-1b9ef134-50d7-48c3-a2b9-e96bc8bf055a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:04.458652 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1b9ef134-50d7-48c3-a2b9-e96bc8bf055a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:04.459361 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1b9ef134-50d7-48c3-a2b9-e96bc8bf055a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:04.460129 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1b9ef134-50d7-48c3-a2b9-e96bc8bf055a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:04.461059 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1b9ef134-50d7-48c3-a2b9-e96bc8bf055a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:04.461759 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1b9ef134-50d7-48c3-a2b9-e96bc8bf055a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:04.462287 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1b9ef134-50d7-48c3-a2b9-e96bc8bf055a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:04.727219 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-1b9ef134-50d7-48c3-a2b9-e96bc8bf055a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:04.758419 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-1b9ef134-50d7-48c3-a2b9-e96bc8bf055a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1321 microversion: 2.1 time: 0.314331 Oct 11 12:01:04.759396 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 68/150] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:04 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1321 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:05.098079 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-659604b6-edf0-4e32-a65f-901e87bfee51 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:05.099100 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-659604b6-edf0-4e32-a65f-901e87bfee51 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:05.107907 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-659604b6-edf0-4e32-a65f-901e87bfee51 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:05.108979 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-659604b6-edf0-4e32-a65f-901e87bfee51 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:05.109735 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-659604b6-edf0-4e32-a65f-901e87bfee51 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:05.110863 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-659604b6-edf0-4e32-a65f-901e87bfee51 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:05.111773 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-659604b6-edf0-4e32-a65f-901e87bfee51 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:05.114651 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-659604b6-edf0-4e32-a65f-901e87bfee51 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:05.344270 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-23a557e3-2e0c-4cf2-8e38-cb94a19bc52d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:05.344978 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-23a557e3-2e0c-4cf2-8e38-cb94a19bc52d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:05.353395 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-23a557e3-2e0c-4cf2-8e38-cb94a19bc52d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:05.354703 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-23a557e3-2e0c-4cf2-8e38-cb94a19bc52d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:05.355519 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-23a557e3-2e0c-4cf2-8e38-cb94a19bc52d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:05.356482 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-23a557e3-2e0c-4cf2-8e38-cb94a19bc52d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:05.357174 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-23a557e3-2e0c-4cf2-8e38-cb94a19bc52d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:05.357847 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-23a557e3-2e0c-4cf2-8e38-cb94a19bc52d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:05.451110 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-659604b6-edf0-4e32-a65f-901e87bfee51 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:05.467579 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-659604b6-edf0-4e32-a65f-901e87bfee51 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1314 microversion: 2.1 time: 0.368844 Oct 11 12:01:05.479560 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 83/151] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:05 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:05.596623 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-23a557e3-2e0c-4cf2-8e38-cb94a19bc52d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:05.605943 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-23a557e3-2e0c-4cf2-8e38-cb94a19bc52d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1366 microversion: 2.1 time: 0.266898 Oct 11 12:01:05.607021 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 69/152] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:05 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:01:05.796230 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-bfcb18c8-6a1c-4183-8aba-5272c71f33cf tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:05.797263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-bfcb18c8-6a1c-4183-8aba-5272c71f33cf tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:05.811414 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bfcb18c8-6a1c-4183-8aba-5272c71f33cf tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:05.813098 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bfcb18c8-6a1c-4183-8aba-5272c71f33cf tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:05.813835 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bfcb18c8-6a1c-4183-8aba-5272c71f33cf tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:05.815958 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bfcb18c8-6a1c-4183-8aba-5272c71f33cf tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:05.817022 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bfcb18c8-6a1c-4183-8aba-5272c71f33cf tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:05.817970 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bfcb18c8-6a1c-4183-8aba-5272c71f33cf tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:06.055106 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-bfcb18c8-6a1c-4183-8aba-5272c71f33cf tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:06.071726 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-bfcb18c8-6a1c-4183-8aba-5272c71f33cf tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1321 microversion: 2.1 time: 0.281950 Oct 11 12:01:06.073142 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 84/153] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:05 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1321 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:06.495731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-79d5b5a2-7708-4dcb-a0f3-db9f0956adc5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:06.496880 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-79d5b5a2-7708-4dcb-a0f3-db9f0956adc5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:06.508005 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-79d5b5a2-7708-4dcb-a0f3-db9f0956adc5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:06.508775 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-79d5b5a2-7708-4dcb-a0f3-db9f0956adc5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:06.509471 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-79d5b5a2-7708-4dcb-a0f3-db9f0956adc5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:06.510638 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-79d5b5a2-7708-4dcb-a0f3-db9f0956adc5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:06.511384 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-79d5b5a2-7708-4dcb-a0f3-db9f0956adc5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:06.512077 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-79d5b5a2-7708-4dcb-a0f3-db9f0956adc5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:06.634471 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a6eadd42-f7e0-48a9-aae6-84ab0ce52bcb tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:06.635445 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a6eadd42-f7e0-48a9-aae6-84ab0ce52bcb tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:06.638982 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=70 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:06.668390 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a6eadd42-f7e0-48a9-aae6-84ab0ce52bcb tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:06.669321 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a6eadd42-f7e0-48a9-aae6-84ab0ce52bcb tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:06.673863 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a6eadd42-f7e0-48a9-aae6-84ab0ce52bcb tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:06.675241 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a6eadd42-f7e0-48a9-aae6-84ab0ce52bcb tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:06.675795 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a6eadd42-f7e0-48a9-aae6-84ab0ce52bcb tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:06.676340 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a6eadd42-f7e0-48a9-aae6-84ab0ce52bcb tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:06.791247 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-79d5b5a2-7708-4dcb-a0f3-db9f0956adc5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:06.808000 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-79d5b5a2-7708-4dcb-a0f3-db9f0956adc5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1314 microversion: 2.1 time: 0.318880 Oct 11 12:01:06.809630 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 70/154] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:06 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:06.924130 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a6eadd42-f7e0-48a9-aae6-84ab0ce52bcb tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:06.936302 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a6eadd42-f7e0-48a9-aae6-84ab0ce52bcb tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1366 microversion: 2.1 time: 0.309608 Oct 11 12:01:06.937234 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 85/155] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:06 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1366 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:07.098259 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-a121e7b7-4e35-4caa-a050-275eaea2fdfb tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:07.099297 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-a121e7b7-4e35-4caa-a050-275eaea2fdfb tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:07.106911 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a121e7b7-4e35-4caa-a050-275eaea2fdfb tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:07.107695 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a121e7b7-4e35-4caa-a050-275eaea2fdfb tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:07.108269 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a121e7b7-4e35-4caa-a050-275eaea2fdfb tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:07.109389 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a121e7b7-4e35-4caa-a050-275eaea2fdfb tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:07.110012 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a121e7b7-4e35-4caa-a050-275eaea2fdfb tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:07.110956 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a121e7b7-4e35-4caa-a050-275eaea2fdfb tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:07.406997 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-a121e7b7-4e35-4caa-a050-275eaea2fdfb tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:07.419119 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-a121e7b7-4e35-4caa-a050-275eaea2fdfb tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1321 microversion: 2.1 time: 0.327118 Oct 11 12:01:07.421012 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 71/156] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:07 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1321 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:01:07.834831 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-fb190ac4-d365-4a77-be5e-57e53258cda5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:07.836273 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-fb190ac4-d365-4a77-be5e-57e53258cda5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:07.844415 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fb190ac4-d365-4a77-be5e-57e53258cda5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:07.846056 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fb190ac4-d365-4a77-be5e-57e53258cda5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:07.847540 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fb190ac4-d365-4a77-be5e-57e53258cda5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:07.847540 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fb190ac4-d365-4a77-be5e-57e53258cda5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:07.848246 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fb190ac4-d365-4a77-be5e-57e53258cda5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:07.848759 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fb190ac4-d365-4a77-be5e-57e53258cda5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:07.987863 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-9890b14a-25a2-4915-89f9-22d80650a3e4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:07.990049 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-9890b14a-25a2-4915-89f9-22d80650a3e4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:08.014351 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9890b14a-25a2-4915-89f9-22d80650a3e4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:08.015688 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9890b14a-25a2-4915-89f9-22d80650a3e4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:08.018213 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9890b14a-25a2-4915-89f9-22d80650a3e4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:08.021873 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9890b14a-25a2-4915-89f9-22d80650a3e4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:08.022986 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9890b14a-25a2-4915-89f9-22d80650a3e4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:08.023957 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9890b14a-25a2-4915-89f9-22d80650a3e4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:08.068029 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-fb190ac4-d365-4a77-be5e-57e53258cda5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:08.082518 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-fb190ac4-d365-4a77-be5e-57e53258cda5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1314 microversion: 2.1 time: 0.252141 Oct 11 12:01:08.091782 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 86/157] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:07 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:08.307242 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-9890b14a-25a2-4915-89f9-22d80650a3e4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:08.320216 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-9890b14a-25a2-4915-89f9-22d80650a3e4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1366 microversion: 2.1 time: 0.338188 Oct 11 12:01:08.320944 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 72/158] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:07 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1366 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:08.455248 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f4803c45-677a-480e-a5b8-e6736ac479af tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:08.456110 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f4803c45-677a-480e-a5b8-e6736ac479af tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:08.473628 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f4803c45-677a-480e-a5b8-e6736ac479af tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:08.474200 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f4803c45-677a-480e-a5b8-e6736ac479af tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:08.474699 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f4803c45-677a-480e-a5b8-e6736ac479af tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:08.477871 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f4803c45-677a-480e-a5b8-e6736ac479af tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:08.480542 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f4803c45-677a-480e-a5b8-e6736ac479af tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:08.482872 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f4803c45-677a-480e-a5b8-e6736ac479af tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:08.723929 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f4803c45-677a-480e-a5b8-e6736ac479af tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:08.738919 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f4803c45-677a-480e-a5b8-e6736ac479af tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1515 microversion: 2.1 time: 0.289266 Oct 11 12:01:08.755357 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 87/159] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:08 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1515 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:08.787654 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-5fe74735-f6ea-4e2c-b746-2750ba795a54 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:01:08.790052 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-5fe74735-f6ea-4e2c-b746-2750ba795a54 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:08.799085 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5fe74735-f6ea-4e2c-b746-2750ba795a54 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:08.799569 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5fe74735-f6ea-4e2c-b746-2750ba795a54 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:08.799997 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5fe74735-f6ea-4e2c-b746-2750ba795a54 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:08.808557 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5fe74735-f6ea-4e2c-b746-2750ba795a54 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:08.809113 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5fe74735-f6ea-4e2c-b746-2750ba795a54 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:08.809552 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5fe74735-f6ea-4e2c-b746-2750ba795a54 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:08.925128 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.objects.instance [None req-5fe74735-f6ea-4e2c-b746-2750ba795a54 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lazy-loading 'flavor' on Instance uuid 70722a52-e702-4e13-a49a-6f2c1161ae35 {{(pid=118994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:01:08.974543 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=100 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:09.107491 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9cb06ee5-1180-459b-a3a4-5b0e2ee19c50 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:09.108277 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9cb06ee5-1180-459b-a3a4-5b0e2ee19c50 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:09.119073 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9cb06ee5-1180-459b-a3a4-5b0e2ee19c50 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:09.123380 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9cb06ee5-1180-459b-a3a4-5b0e2ee19c50 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:09.124372 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9cb06ee5-1180-459b-a3a4-5b0e2ee19c50 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:09.125700 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9cb06ee5-1180-459b-a3a4-5b0e2ee19c50 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:09.139074 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9cb06ee5-1180-459b-a3a4-5b0e2ee19c50 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:09.139074 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9cb06ee5-1180-459b-a3a4-5b0e2ee19c50 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:09.258214 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-5fe74735-f6ea-4e2c-b746-2750ba795a54 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "POST /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35/action" status: 200 len: 32 microversion: 2.1 time: 0.474582 Oct 11 12:01:09.263944 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 73/160] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Oct 11 12:01:08 2022] POST /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35/action => generated 32 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 12:01:09.272901 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-84f1fba7-6690-4df9-98f1-fee9ba16aa11 req-712d41c5-d4ad-4cac-9537-54947cb1fdb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c49bf4e1-912c-47b2-9761-88325bf6d533", "name": "network-vif-plugged", "status": "completed", "tag": "9d2064c6-cfc0-4a34-a19a-dfcb06301457"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:01:09.287115 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-84f1fba7-6690-4df9-98f1-fee9ba16aa11 req-712d41c5-d4ad-4cac-9537-54947cb1fdb5 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:09.287962 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-84f1fba7-6690-4df9-98f1-fee9ba16aa11 req-712d41c5-d4ad-4cac-9537-54947cb1fdb5 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:09.288625 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-84f1fba7-6690-4df9-98f1-fee9ba16aa11 req-712d41c5-d4ad-4cac-9537-54947cb1fdb5 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:09.334537 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-84f1fba7-6690-4df9-98f1-fee9ba16aa11 req-712d41c5-d4ad-4cac-9537-54947cb1fdb5 service nova] Creating event network-vif-plugged:9d2064c6-cfc0-4a34-a19a-dfcb06301457 for instance c49bf4e1-912c-47b2-9761-88325bf6d533 on hv-cinder-82099 Oct 11 12:01:09.345547 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-84f1fba7-6690-4df9-98f1-fee9ba16aa11 req-712d41c5-d4ad-4cac-9537-54947cb1fdb5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078666 Oct 11 12:01:09.346469 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 74/161] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:01:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:01:09.366989 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-e54ccb2b-4559-4f79-ac31-5020fe536f77 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:09.368293 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-e54ccb2b-4559-4f79-ac31-5020fe536f77 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:09.387893 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e54ccb2b-4559-4f79-ac31-5020fe536f77 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:09.391066 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e54ccb2b-4559-4f79-ac31-5020fe536f77 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:09.392103 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e54ccb2b-4559-4f79-ac31-5020fe536f77 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:09.393700 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e54ccb2b-4559-4f79-ac31-5020fe536f77 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:09.397214 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e54ccb2b-4559-4f79-ac31-5020fe536f77 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:09.398044 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e54ccb2b-4559-4f79-ac31-5020fe536f77 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:09.458453 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-9cb06ee5-1180-459b-a3a4-5b0e2ee19c50 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:09.473473 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9cb06ee5-1180-459b-a3a4-5b0e2ee19c50 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1314 microversion: 2.1 time: 0.370096 Oct 11 12:01:09.474935 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 88/162] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:09 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:09.500119 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-1b4373cb-afe7-4a80-8d0b-2d1378240270 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:09.505389 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-1b4373cb-afe7-4a80-8d0b-2d1378240270 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:09.539540 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1b4373cb-afe7-4a80-8d0b-2d1378240270 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:09.541249 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1b4373cb-afe7-4a80-8d0b-2d1378240270 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:09.544915 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1b4373cb-afe7-4a80-8d0b-2d1378240270 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:09.559472 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1b4373cb-afe7-4a80-8d0b-2d1378240270 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:09.564414 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1b4373cb-afe7-4a80-8d0b-2d1378240270 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:09.565999 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1b4373cb-afe7-4a80-8d0b-2d1378240270 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:09.808466 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-e54ccb2b-4559-4f79-ac31-5020fe536f77 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:09.836686 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-e54ccb2b-4559-4f79-ac31-5020fe536f77 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1521 microversion: 2.1 time: 0.488246 Oct 11 12:01:09.841400 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 75/163] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:09 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1521 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:10.508031 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-2ba865fb-93db-48e8-9ae2-2e8085cd9d2b tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:10.508986 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-2ba865fb-93db-48e8-9ae2-2e8085cd9d2b tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:10.527534 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2ba865fb-93db-48e8-9ae2-2e8085cd9d2b tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:10.527706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-1b4373cb-afe7-4a80-8d0b-2d1378240270 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:10.528394 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2ba865fb-93db-48e8-9ae2-2e8085cd9d2b tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:10.528534 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2ba865fb-93db-48e8-9ae2-2e8085cd9d2b tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:10.529155 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2ba865fb-93db-48e8-9ae2-2e8085cd9d2b tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:10.529616 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2ba865fb-93db-48e8-9ae2-2e8085cd9d2b tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:10.530036 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2ba865fb-93db-48e8-9ae2-2e8085cd9d2b tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:10.561008 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-1b4373cb-afe7-4a80-8d0b-2d1378240270 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1557 microversion: 2.1 time: 1.082652 Oct 11 12:01:10.571242 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 89/164] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:09 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1557 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:10.614108 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-01c811a8-abf1-4fd0-90e9-a2416f23a01c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:10.626611 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-01c811a8-abf1-4fd0-90e9-a2416f23a01c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:10.658382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-01c811a8-abf1-4fd0-90e9-a2416f23a01c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:10.660581 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-01c811a8-abf1-4fd0-90e9-a2416f23a01c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:10.666931 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-01c811a8-abf1-4fd0-90e9-a2416f23a01c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:10.668686 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-01c811a8-abf1-4fd0-90e9-a2416f23a01c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:10.669798 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-01c811a8-abf1-4fd0-90e9-a2416f23a01c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:10.673944 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-01c811a8-abf1-4fd0-90e9-a2416f23a01c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:10.826673 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-2ba865fb-93db-48e8-9ae2-2e8085cd9d2b tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:10.860277 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-2ba865fb-93db-48e8-9ae2-2e8085cd9d2b tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1314 microversion: 2.1 time: 0.361836 Oct 11 12:01:10.871389 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 76/165] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:10 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1314 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:01:10.894731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-cd703b1d-b8e7-4639-ab38-bd14115ee0da tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:10.895631 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-cd703b1d-b8e7-4639-ab38-bd14115ee0da tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:10.912353 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cd703b1d-b8e7-4639-ab38-bd14115ee0da tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:10.914345 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cd703b1d-b8e7-4639-ab38-bd14115ee0da tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:10.916617 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cd703b1d-b8e7-4639-ab38-bd14115ee0da tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:10.918703 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cd703b1d-b8e7-4639-ab38-bd14115ee0da tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:10.927262 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cd703b1d-b8e7-4639-ab38-bd14115ee0da tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:10.934005 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cd703b1d-b8e7-4639-ab38-bd14115ee0da tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:11.007387 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-01c811a8-abf1-4fd0-90e9-a2416f23a01c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.400458 Oct 11 12:01:11.008466 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 90/166] 10.222.0.59 () {58 vars in 1275 bytes} [Tue Oct 11 12:01:10 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186/os-interface => generated 285 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:01:11.418326 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-cd703b1d-b8e7-4639-ab38-bd14115ee0da tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:11.428540 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-d2b68c74-02d6-4cc5-8544-0cde5c751eaf req-f24aa9c2-3f3e-45d1-b7cd-5706a0c59a9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6da2ee3-f7c1-4cab-a6bd-096baa684fca", "name": "network-vif-plugged", "status": "completed", "tag": "4d99dc26-3a74-4c26-8fb0-ce3917c1284f"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:01:11.432143 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-cd703b1d-b8e7-4639-ab38-bd14115ee0da tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1521 microversion: 2.1 time: 0.543706 Oct 11 12:01:11.432769 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 77/167] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:10 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1521 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:01:11.466732 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-d2b68c74-02d6-4cc5-8544-0cde5c751eaf req-f24aa9c2-3f3e-45d1-b7cd-5706a0c59a9d service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:11.471416 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-d2b68c74-02d6-4cc5-8544-0cde5c751eaf req-f24aa9c2-3f3e-45d1-b7cd-5706a0c59a9d service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:11.471979 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-d2b68c74-02d6-4cc5-8544-0cde5c751eaf req-f24aa9c2-3f3e-45d1-b7cd-5706a0c59a9d service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:11.498122 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-d2b68c74-02d6-4cc5-8544-0cde5c751eaf req-f24aa9c2-3f3e-45d1-b7cd-5706a0c59a9d service nova] Creating event network-vif-plugged:4d99dc26-3a74-4c26-8fb0-ce3917c1284f for instance a6da2ee3-f7c1-4cab-a6bd-096baa684fca on hv-cinder-82099 Oct 11 12:01:11.516631 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-d2b68c74-02d6-4cc5-8544-0cde5c751eaf req-f24aa9c2-3f3e-45d1-b7cd-5706a0c59a9d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091783 Oct 11 12:01:11.518487 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 91/168] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:01:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 12:01:11.914471 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-39b7545d-d480-420c-bec6-f5fa380978e5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:11.915906 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-39b7545d-d480-420c-bec6-f5fa380978e5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:11.925294 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-39b7545d-d480-420c-bec6-f5fa380978e5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:11.925963 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-39b7545d-d480-420c-bec6-f5fa380978e5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:11.926520 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-39b7545d-d480-420c-bec6-f5fa380978e5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:11.927676 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-39b7545d-d480-420c-bec6-f5fa380978e5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:11.928422 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-39b7545d-d480-420c-bec6-f5fa380978e5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:11.928980 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-39b7545d-d480-420c-bec6-f5fa380978e5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:12.309129 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-39b7545d-d480-420c-bec6-f5fa380978e5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:12.318007 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-39b7545d-d480-420c-bec6-f5fa380978e5 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1314 microversion: 2.1 time: 0.408152 Oct 11 12:01:12.321170 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 78/169] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:11 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:12.466026 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-83689af7-4863-4ba0-9e59-4f45826e29e6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:12.467430 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-83689af7-4863-4ba0-9e59-4f45826e29e6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:12.479647 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-83689af7-4863-4ba0-9e59-4f45826e29e6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:12.484029 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-83689af7-4863-4ba0-9e59-4f45826e29e6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:12.484648 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-83689af7-4863-4ba0-9e59-4f45826e29e6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:12.485597 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-83689af7-4863-4ba0-9e59-4f45826e29e6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:12.486074 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-83689af7-4863-4ba0-9e59-4f45826e29e6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:12.486502 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-83689af7-4863-4ba0-9e59-4f45826e29e6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:13.361558 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-b9ff5982-8f1a-47f7-b0d0-ab6461048b13 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:13.362169 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-b9ff5982-8f1a-47f7-b0d0-ab6461048b13 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:13.378203 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b9ff5982-8f1a-47f7-b0d0-ab6461048b13 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:13.378723 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b9ff5982-8f1a-47f7-b0d0-ab6461048b13 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:13.379736 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b9ff5982-8f1a-47f7-b0d0-ab6461048b13 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:13.380894 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b9ff5982-8f1a-47f7-b0d0-ab6461048b13 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:13.381363 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b9ff5982-8f1a-47f7-b0d0-ab6461048b13 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:13.381789 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b9ff5982-8f1a-47f7-b0d0-ab6461048b13 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:13.456495 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-83689af7-4863-4ba0-9e59-4f45826e29e6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:13.466640 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-83689af7-4863-4ba0-9e59-4f45826e29e6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1521 microversion: 2.1 time: 1.004720 Oct 11 12:01:13.468402 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 92/170] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:12 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1521 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:13.701427 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-b9ff5982-8f1a-47f7-b0d0-ab6461048b13 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:13.718671 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-b9ff5982-8f1a-47f7-b0d0-ab6461048b13 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1500 microversion: 2.1 time: 0.360283 Oct 11 12:01:13.720581 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 79/171] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:13 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1500 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:14.194161 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-433f7b00-7774-4279-a409-af7025f67848 req-2c5b16ba-92ca-435c-8131-3fc6232d2597 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ac5dba27-8c1b-4760-ad6f-7ab81244e186", "tag": "4fee3639-3c5d-4ff4-9533-5ba1ecbb3bb5"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:01:14.218355 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-433f7b00-7774-4279-a409-af7025f67848 req-2c5b16ba-92ca-435c-8131-3fc6232d2597 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:14.218748 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-433f7b00-7774-4279-a409-af7025f67848 req-2c5b16ba-92ca-435c-8131-3fc6232d2597 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:14.222948 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-433f7b00-7774-4279-a409-af7025f67848 req-2c5b16ba-92ca-435c-8131-3fc6232d2597 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:14.277999 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-433f7b00-7774-4279-a409-af7025f67848 req-2c5b16ba-92ca-435c-8131-3fc6232d2597 service nova] Creating event network-changed:4fee3639-3c5d-4ff4-9533-5ba1ecbb3bb5 for instance ac5dba27-8c1b-4760-ad6f-7ab81244e186 on hv-cinder-82099 Oct 11 12:01:14.292317 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-433f7b00-7774-4279-a409-af7025f67848 req-2c5b16ba-92ca-435c-8131-3fc6232d2597 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102473 Oct 11 12:01:14.296872 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 93/172] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:01:14.505603 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-8340d726-d852-4034-959f-bd0fcff67fe7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:14.507760 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-8340d726-d852-4034-959f-bd0fcff67fe7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:14.523923 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8340d726-d852-4034-959f-bd0fcff67fe7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:14.525281 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8340d726-d852-4034-959f-bd0fcff67fe7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:14.526721 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8340d726-d852-4034-959f-bd0fcff67fe7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:14.528857 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8340d726-d852-4034-959f-bd0fcff67fe7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:14.530051 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8340d726-d852-4034-959f-bd0fcff67fe7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:14.533273 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8340d726-d852-4034-959f-bd0fcff67fe7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:14.899574 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-8340d726-d852-4034-959f-bd0fcff67fe7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:14.917106 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-8340d726-d852-4034-959f-bd0fcff67fe7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1521 microversion: 2.1 time: 0.424477 Oct 11 12:01:14.919411 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 80/173] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:14 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1521 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:15.953055 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f84ee84c-3e80-4353-bdfb-416b170dd84e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:15.956492 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f84ee84c-3e80-4353-bdfb-416b170dd84e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:15.983120 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f84ee84c-3e80-4353-bdfb-416b170dd84e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:15.984082 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f84ee84c-3e80-4353-bdfb-416b170dd84e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:15.985917 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f84ee84c-3e80-4353-bdfb-416b170dd84e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:15.987586 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f84ee84c-3e80-4353-bdfb-416b170dd84e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:15.988999 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f84ee84c-3e80-4353-bdfb-416b170dd84e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:15.990703 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f84ee84c-3e80-4353-bdfb-416b170dd84e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:16.264116 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f84ee84c-3e80-4353-bdfb-416b170dd84e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:16.301049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f84ee84c-3e80-4353-bdfb-416b170dd84e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1521 microversion: 2.1 time: 0.356266 Oct 11 12:01:16.302204 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 94/174] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:15 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:17.344449 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-05d3e3df-9cf6-4bc2-9734-be5aa96d0ae1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:17.346528 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-05d3e3df-9cf6-4bc2-9734-be5aa96d0ae1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:17.360275 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-05d3e3df-9cf6-4bc2-9734-be5aa96d0ae1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:17.361249 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-05d3e3df-9cf6-4bc2-9734-be5aa96d0ae1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:17.362098 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-05d3e3df-9cf6-4bc2-9734-be5aa96d0ae1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:17.363484 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-05d3e3df-9cf6-4bc2-9734-be5aa96d0ae1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:17.364445 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-05d3e3df-9cf6-4bc2-9734-be5aa96d0ae1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:17.365363 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-05d3e3df-9cf6-4bc2-9734-be5aa96d0ae1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:17.617184 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-05d3e3df-9cf6-4bc2-9734-be5aa96d0ae1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:17.626376 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-05d3e3df-9cf6-4bc2-9734-be5aa96d0ae1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1521 microversion: 2.1 time: 0.291723 Oct 11 12:01:17.627374 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 81/175] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:17 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:17.939583 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0519ce89-1469-4527-a407-e9e7ccb86636 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56e77352-4bc9-4f1b-8bef-d956d232d266"}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:01:17.942117 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0519ce89-1469-4527-a407-e9e7ccb86636 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:17.950338 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0519ce89-1469-4527-a407-e9e7ccb86636 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:17.950878 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0519ce89-1469-4527-a407-e9e7ccb86636 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:17.951317 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0519ce89-1469-4527-a407-e9e7ccb86636 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:17.952026 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0519ce89-1469-4527-a407-e9e7ccb86636 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:17.956303 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0519ce89-1469-4527-a407-e9e7ccb86636 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:17.956662 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0519ce89-1469-4527-a407-e9e7ccb86636 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:18.677106 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-9a2d64e2-6dc9-4665-b0ac-76de48529b4c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:18.678824 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-9a2d64e2-6dc9-4665-b0ac-76de48529b4c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:18.690023 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9a2d64e2-6dc9-4665-b0ac-76de48529b4c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:18.691326 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9a2d64e2-6dc9-4665-b0ac-76de48529b4c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:18.692075 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9a2d64e2-6dc9-4665-b0ac-76de48529b4c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:18.693219 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9a2d64e2-6dc9-4665-b0ac-76de48529b4c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:18.693937 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9a2d64e2-6dc9-4665-b0ac-76de48529b4c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:18.694408 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9a2d64e2-6dc9-4665-b0ac-76de48529b4c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:18.910983 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-9a2d64e2-6dc9-4665-b0ac-76de48529b4c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:18.933869 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-9a2d64e2-6dc9-4665-b0ac-76de48529b4c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1521 microversion: 2.1 time: 0.267392 Oct 11 12:01:18.934598 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 82/176] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:18 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:19.966794 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-4cb0d61e-0d5b-4146-8de3-ab5152341500 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:19.968797 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-4cb0d61e-0d5b-4146-8de3-ab5152341500 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:19.976874 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4cb0d61e-0d5b-4146-8de3-ab5152341500 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:19.977726 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4cb0d61e-0d5b-4146-8de3-ab5152341500 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:19.978753 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4cb0d61e-0d5b-4146-8de3-ab5152341500 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:19.979944 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4cb0d61e-0d5b-4146-8de3-ab5152341500 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:19.980639 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4cb0d61e-0d5b-4146-8de3-ab5152341500 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:19.981179 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4cb0d61e-0d5b-4146-8de3-ab5152341500 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:20.219493 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-4cb0d61e-0d5b-4146-8de3-ab5152341500 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:20.227803 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-4cb0d61e-0d5b-4146-8de3-ab5152341500 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1521 microversion: 2.1 time: 0.273461 Oct 11 12:01:20.244621 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 83/177] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:19 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:21.251607 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-225d2a4f-d52d-4317-a1e1-271df555808d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:21.252251 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-225d2a4f-d52d-4317-a1e1-271df555808d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:21.259172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-225d2a4f-d52d-4317-a1e1-271df555808d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:21.259744 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-225d2a4f-d52d-4317-a1e1-271df555808d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:21.260205 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-225d2a4f-d52d-4317-a1e1-271df555808d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:21.260944 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-225d2a4f-d52d-4317-a1e1-271df555808d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:21.261431 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-225d2a4f-d52d-4317-a1e1-271df555808d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:21.261881 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-225d2a4f-d52d-4317-a1e1-271df555808d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:21.417884 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-225d2a4f-d52d-4317-a1e1-271df555808d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:21.428605 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-225d2a4f-d52d-4317-a1e1-271df555808d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1521 microversion: 2.1 time: 0.180708 Oct 11 12:01:21.429234 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 84/178] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:21 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:22.280756 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0519ce89-1469-4527-a407-e9e7ccb86636 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "POST /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.347733 Oct 11 12:01:22.281868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 95/179] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Oct 11 12:01:17 2022] POST /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533/os-volume_attachments => generated 194 bytes in 4351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 12:01:22.452713 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-1d22c287-5c70-4bea-a323-e9e656015fce tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:22.453356 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-1d22c287-5c70-4bea-a323-e9e656015fce tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:22.461650 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1d22c287-5c70-4bea-a323-e9e656015fce tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:22.462172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1d22c287-5c70-4bea-a323-e9e656015fce tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:22.462833 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1d22c287-5c70-4bea-a323-e9e656015fce tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:22.463515 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1d22c287-5c70-4bea-a323-e9e656015fce tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:22.463977 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1d22c287-5c70-4bea-a323-e9e656015fce tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:22.464395 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1d22c287-5c70-4bea-a323-e9e656015fce tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:22.610684 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-1d22c287-5c70-4bea-a323-e9e656015fce tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:22.619213 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-1d22c287-5c70-4bea-a323-e9e656015fce tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1521 microversion: 2.1 time: 0.171029 Oct 11 12:01:22.619880 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 85/180] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:22 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:23.647568 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-95c6d123-fa90-4309-a286-b3c4ec410caf tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:23.648278 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-95c6d123-fa90-4309-a286-b3c4ec410caf tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:23.656230 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-95c6d123-fa90-4309-a286-b3c4ec410caf tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:23.656631 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-95c6d123-fa90-4309-a286-b3c4ec410caf tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:23.657128 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-95c6d123-fa90-4309-a286-b3c4ec410caf tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:23.657872 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-95c6d123-fa90-4309-a286-b3c4ec410caf tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:23.658320 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-95c6d123-fa90-4309-a286-b3c4ec410caf tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:23.658852 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-95c6d123-fa90-4309-a286-b3c4ec410caf tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:23.803019 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-95c6d123-fa90-4309-a286-b3c4ec410caf tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:23.812456 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-95c6d123-fa90-4309-a286-b3c4ec410caf tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1521 microversion: 2.1 time: 0.169618 Oct 11 12:01:23.813231 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 96/181] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:23 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:24.839576 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-4c67b1a6-ccf0-49ba-a29d-56bd3823bead tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:24.840577 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-4c67b1a6-ccf0-49ba-a29d-56bd3823bead tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:24.849563 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4c67b1a6-ccf0-49ba-a29d-56bd3823bead tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:24.850219 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4c67b1a6-ccf0-49ba-a29d-56bd3823bead tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:24.850845 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4c67b1a6-ccf0-49ba-a29d-56bd3823bead tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:24.851872 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4c67b1a6-ccf0-49ba-a29d-56bd3823bead tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:24.852536 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4c67b1a6-ccf0-49ba-a29d-56bd3823bead tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:24.853179 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4c67b1a6-ccf0-49ba-a29d-56bd3823bead tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:25.041237 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-4c67b1a6-ccf0-49ba-a29d-56bd3823bead tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:25.050072 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-4c67b1a6-ccf0-49ba-a29d-56bd3823bead tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1521 microversion: 2.1 time: 0.216811 Oct 11 12:01:25.050699 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 86/182] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:24 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:01:26.076390 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-039e7033-b414-4a95-a330-aa830cb23dc9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:26.077392 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-039e7033-b414-4a95-a330-aa830cb23dc9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:26.095306 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-039e7033-b414-4a95-a330-aa830cb23dc9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:26.095306 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-039e7033-b414-4a95-a330-aa830cb23dc9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:26.095306 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-039e7033-b414-4a95-a330-aa830cb23dc9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:26.095306 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-039e7033-b414-4a95-a330-aa830cb23dc9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:26.096012 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-039e7033-b414-4a95-a330-aa830cb23dc9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:26.096012 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-039e7033-b414-4a95-a330-aa830cb23dc9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:26.260128 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-039e7033-b414-4a95-a330-aa830cb23dc9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:26.269381 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-039e7033-b414-4a95-a330-aa830cb23dc9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1521 microversion: 2.1 time: 0.197229 Oct 11 12:01:26.270078 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 97/183] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:26 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:27.311677 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-a45b2611-5663-4b23-8cd8-daa6a611898c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:27.312734 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-a45b2611-5663-4b23-8cd8-daa6a611898c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:27.335833 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a45b2611-5663-4b23-8cd8-daa6a611898c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:27.336815 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a45b2611-5663-4b23-8cd8-daa6a611898c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:27.338194 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a45b2611-5663-4b23-8cd8-daa6a611898c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:27.356466 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a45b2611-5663-4b23-8cd8-daa6a611898c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:27.358239 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a45b2611-5663-4b23-8cd8-daa6a611898c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:27.362791 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a45b2611-5663-4b23-8cd8-daa6a611898c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:27.575720 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-a45b2611-5663-4b23-8cd8-daa6a611898c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:27.596321 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-a45b2611-5663-4b23-8cd8-daa6a611898c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1521 microversion: 2.1 time: 0.291829 Oct 11 12:01:27.597454 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 87/184] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:27 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:28.627060 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-aa6df057-4b8d-480b-b546-0576045ec9d8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:28.628425 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-aa6df057-4b8d-480b-b546-0576045ec9d8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:28.641022 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aa6df057-4b8d-480b-b546-0576045ec9d8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:28.642118 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aa6df057-4b8d-480b-b546-0576045ec9d8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:28.642942 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aa6df057-4b8d-480b-b546-0576045ec9d8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:28.643917 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aa6df057-4b8d-480b-b546-0576045ec9d8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:28.644516 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aa6df057-4b8d-480b-b546-0576045ec9d8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:28.645044 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aa6df057-4b8d-480b-b546-0576045ec9d8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:28.841242 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-aa6df057-4b8d-480b-b546-0576045ec9d8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:28.845817 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:28.851430 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-aa6df057-4b8d-480b-b546-0576045ec9d8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1521 microversion: 2.1 time: 0.233930 Oct 11 12:01:28.852229 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 98/185] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:28 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:29.879722 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-f540b2b0-b91a-48ed-a12c-4a34a3b2c339 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:29.880923 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-f540b2b0-b91a-48ed-a12c-4a34a3b2c339 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:29.891801 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f540b2b0-b91a-48ed-a12c-4a34a3b2c339 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:29.893317 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f540b2b0-b91a-48ed-a12c-4a34a3b2c339 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:29.894716 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f540b2b0-b91a-48ed-a12c-4a34a3b2c339 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:29.896203 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f540b2b0-b91a-48ed-a12c-4a34a3b2c339 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:29.897445 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f540b2b0-b91a-48ed-a12c-4a34a3b2c339 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:29.898354 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f540b2b0-b91a-48ed-a12c-4a34a3b2c339 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:30.137809 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-f540b2b0-b91a-48ed-a12c-4a34a3b2c339 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:30.153152 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-f540b2b0-b91a-48ed-a12c-4a34a3b2c339 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1521 microversion: 2.1 time: 0.279816 Oct 11 12:01:30.154735 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 88/186] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:29 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:31.178334 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9a069022-bd64-4092-82f1-4c1da6b660ad tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:31.181465 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9a069022-bd64-4092-82f1-4c1da6b660ad tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:31.193574 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9a069022-bd64-4092-82f1-4c1da6b660ad tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:31.194811 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9a069022-bd64-4092-82f1-4c1da6b660ad tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:31.195473 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9a069022-bd64-4092-82f1-4c1da6b660ad tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:31.197028 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9a069022-bd64-4092-82f1-4c1da6b660ad tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:31.197641 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9a069022-bd64-4092-82f1-4c1da6b660ad tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:31.198423 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9a069022-bd64-4092-82f1-4c1da6b660ad tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:31.487345 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-9a069022-bd64-4092-82f1-4c1da6b660ad tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:31.506014 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9a069022-bd64-4092-82f1-4c1da6b660ad tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1521 microversion: 2.1 time: 0.331558 Oct 11 12:01:31.507030 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 99/187] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:31 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1521 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:32.533527 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-c689dcd3-0d23-4c6b-bf0c-699b404d20a0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:32.534307 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-c689dcd3-0d23-4c6b-bf0c-699b404d20a0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:32.536451 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_api:SELECT=48 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:32.541983 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c689dcd3-0d23-4c6b-bf0c-699b404d20a0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:32.542471 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c689dcd3-0d23-4c6b-bf0c-699b404d20a0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:32.543323 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c689dcd3-0d23-4c6b-bf0c-699b404d20a0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:32.544037 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c689dcd3-0d23-4c6b-bf0c-699b404d20a0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:32.544490 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c689dcd3-0d23-4c6b-bf0c-699b404d20a0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:32.544906 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c689dcd3-0d23-4c6b-bf0c-699b404d20a0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:32.562804 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:32.728363 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-c689dcd3-0d23-4c6b-bf0c-699b404d20a0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:32.742390 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-c689dcd3-0d23-4c6b-bf0c-699b404d20a0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1521 microversion: 2.1 time: 0.213346 Oct 11 12:01:32.759116 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 89/188] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:32 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:01:33.781663 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ff2438a8-d278-46ec-88d1-f420eb245cab tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:33.783265 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ff2438a8-d278-46ec-88d1-f420eb245cab tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:33.791777 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ff2438a8-d278-46ec-88d1-f420eb245cab tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:33.792702 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ff2438a8-d278-46ec-88d1-f420eb245cab tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:33.793454 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ff2438a8-d278-46ec-88d1-f420eb245cab tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:33.794361 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ff2438a8-d278-46ec-88d1-f420eb245cab tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:33.795714 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ff2438a8-d278-46ec-88d1-f420eb245cab tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:33.796398 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ff2438a8-d278-46ec-88d1-f420eb245cab tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:34.097296 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ff2438a8-d278-46ec-88d1-f420eb245cab tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:34.108680 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ff2438a8-d278-46ec-88d1-f420eb245cab tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1521 microversion: 2.1 time: 0.336280 Oct 11 12:01:34.109308 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 100/189] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:33 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1521 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:35.158094 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-38803194-a239-4208-a070-3e48348d990b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:35.160208 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-38803194-a239-4208-a070-3e48348d990b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:35.170550 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-38803194-a239-4208-a070-3e48348d990b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:35.171422 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-38803194-a239-4208-a070-3e48348d990b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:35.172132 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-38803194-a239-4208-a070-3e48348d990b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:35.173315 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-38803194-a239-4208-a070-3e48348d990b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:35.174099 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-38803194-a239-4208-a070-3e48348d990b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:35.175034 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-38803194-a239-4208-a070-3e48348d990b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:35.338697 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-38803194-a239-4208-a070-3e48348d990b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:35.351995 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-38803194-a239-4208-a070-3e48348d990b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1521 microversion: 2.1 time: 0.203048 Oct 11 12:01:35.354869 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 90/190] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:35 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1521 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:36.377919 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-94a5c221-8b85-4298-b1ef-eaa41c655859 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:36.378941 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-94a5c221-8b85-4298-b1ef-eaa41c655859 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:36.386424 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-94a5c221-8b85-4298-b1ef-eaa41c655859 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:36.387410 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-94a5c221-8b85-4298-b1ef-eaa41c655859 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:36.388101 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-94a5c221-8b85-4298-b1ef-eaa41c655859 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:36.389076 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-94a5c221-8b85-4298-b1ef-eaa41c655859 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:36.389565 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-94a5c221-8b85-4298-b1ef-eaa41c655859 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:36.390000 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-94a5c221-8b85-4298-b1ef-eaa41c655859 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:36.607569 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-94a5c221-8b85-4298-b1ef-eaa41c655859 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:36.616482 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-94a5c221-8b85-4298-b1ef-eaa41c655859 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1521 microversion: 2.1 time: 0.243850 Oct 11 12:01:36.617564 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 101/191] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:36 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:37.642579 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-516e766b-a659-429a-80b2-4aa1bcef4b73 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:37.643652 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-516e766b-a659-429a-80b2-4aa1bcef4b73 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:37.653433 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-516e766b-a659-429a-80b2-4aa1bcef4b73 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:37.654930 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-516e766b-a659-429a-80b2-4aa1bcef4b73 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:37.654930 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-516e766b-a659-429a-80b2-4aa1bcef4b73 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:37.655303 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-516e766b-a659-429a-80b2-4aa1bcef4b73 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:37.655603 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-516e766b-a659-429a-80b2-4aa1bcef4b73 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:37.656021 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-516e766b-a659-429a-80b2-4aa1bcef4b73 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:37.848970 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-516e766b-a659-429a-80b2-4aa1bcef4b73 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:37.860999 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-516e766b-a659-429a-80b2-4aa1bcef4b73 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1521 microversion: 2.1 time: 0.223688 Oct 11 12:01:37.861691 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 91/192] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:37 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:38.546123 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-92245f22-e18c-4626-8638-ab5c24d27cba tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:38.547116 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-92245f22-e18c-4626-8638-ab5c24d27cba tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:38.551651 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=34 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:38.564896 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-92245f22-e18c-4626-8638-ab5c24d27cba tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:38.565810 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-92245f22-e18c-4626-8638-ab5c24d27cba tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:38.566643 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-92245f22-e18c-4626-8638-ab5c24d27cba tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:38.568247 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-92245f22-e18c-4626-8638-ab5c24d27cba tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:38.569285 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-92245f22-e18c-4626-8638-ab5c24d27cba tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:38.570245 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-92245f22-e18c-4626-8638-ab5c24d27cba tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:38.609268 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-92245f22-e18c-4626-8638-ab5c24d27cba tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Going to try to terminate instance {{(pid=118995) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 12:01:38.734149 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-92245f22-e18c-4626-8638-ab5c24d27cba tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 204 len: 0 microversion: 2.1 time: 0.202150 Oct 11 12:01:38.741214 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 102/193] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Oct 11 12:01:38 2022] DELETE /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 12:01:38.745407 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-9dc173f5-3760-45e5-baef-f590376229cf tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:38.746875 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-9dc173f5-3760-45e5-baef-f590376229cf tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:38.753712 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9dc173f5-3760-45e5-baef-f590376229cf tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:38.754599 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9dc173f5-3760-45e5-baef-f590376229cf tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:38.755265 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9dc173f5-3760-45e5-baef-f590376229cf tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:38.756654 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9dc173f5-3760-45e5-baef-f590376229cf tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:38.757511 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9dc173f5-3760-45e5-baef-f590376229cf tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:38.758143 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9dc173f5-3760-45e5-baef-f590376229cf tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:38.897593 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-746bfadb-6754-48c0-9cb3-a64bd455a0a0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:38.898385 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-746bfadb-6754-48c0-9cb3-a64bd455a0a0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:38.910959 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-746bfadb-6754-48c0-9cb3-a64bd455a0a0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:38.911777 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-746bfadb-6754-48c0-9cb3-a64bd455a0a0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:38.912755 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-746bfadb-6754-48c0-9cb3-a64bd455a0a0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:38.914498 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-746bfadb-6754-48c0-9cb3-a64bd455a0a0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:38.916696 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-746bfadb-6754-48c0-9cb3-a64bd455a0a0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:38.924861 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-746bfadb-6754-48c0-9cb3-a64bd455a0a0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:39.025834 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-9dc173f5-3760-45e5-baef-f590376229cf tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:39.062286 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-9dc173f5-3760-45e5-baef-f590376229cf tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1552 microversion: 2.1 time: 0.319282 Oct 11 12:01:39.068713 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 92/194] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:38 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1552 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:39.212359 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-746bfadb-6754-48c0-9cb3-a64bd455a0a0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:39.222614 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-746bfadb-6754-48c0-9cb3-a64bd455a0a0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1521 microversion: 2.1 time: 0.332923 Oct 11 12:01:39.225470 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 103/195] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:38 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1521 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:01:40.093451 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-72fa5056-cbc9-453c-8573-e0104e2dd60c tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:40.096565 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-72fa5056-cbc9-453c-8573-e0104e2dd60c tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:40.106839 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-72fa5056-cbc9-453c-8573-e0104e2dd60c tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:40.107394 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-72fa5056-cbc9-453c-8573-e0104e2dd60c tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:40.107997 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-72fa5056-cbc9-453c-8573-e0104e2dd60c tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:40.108692 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-72fa5056-cbc9-453c-8573-e0104e2dd60c tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:40.109131 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-72fa5056-cbc9-453c-8573-e0104e2dd60c tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:40.109751 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-72fa5056-cbc9-453c-8573-e0104e2dd60c tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:40.268275 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5c16afc1-a3f8-41da-9229-1617fd92b61c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:40.271313 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-5c16afc1-a3f8-41da-9229-1617fd92b61c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:40.282640 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5c16afc1-a3f8-41da-9229-1617fd92b61c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:40.283435 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5c16afc1-a3f8-41da-9229-1617fd92b61c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:40.284050 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5c16afc1-a3f8-41da-9229-1617fd92b61c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:40.285093 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5c16afc1-a3f8-41da-9229-1617fd92b61c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:40.285710 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5c16afc1-a3f8-41da-9229-1617fd92b61c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:40.286240 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5c16afc1-a3f8-41da-9229-1617fd92b61c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:40.332541 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-72fa5056-cbc9-453c-8573-e0104e2dd60c tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:40.348057 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-72fa5056-cbc9-453c-8573-e0104e2dd60c tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1552 microversion: 2.1 time: 0.261348 Oct 11 12:01:40.349296 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 93/196] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:40 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1552 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:40.408519 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-baa82622-b89b-456b-a610-dc2dc07c190e tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1169552618", "imageRef": "09bcc8f8-a32f-4ec8-9ab2-a98964ad6a01", "flavorRef": "452", "networks": [{"uuid": "48fbb130-efad-44e2-81ce-c59f94ee5b96"}]}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:01:40.452903 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5c16afc1-a3f8-41da-9229-1617fd92b61c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:40.464366 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5c16afc1-a3f8-41da-9229-1617fd92b61c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1521 microversion: 2.1 time: 0.221186 Oct 11 12:01:40.483106 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 104/197] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:40 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:40.497089 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.network.neutron [None req-baa82622-b89b-456b-a610-dc2dc07c190e tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] validate_networks() for [('48fbb130-efad-44e2-81ce-c59f94ee5b96', None, None, None, None, None)] {{(pid=118994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 12:01:41.008845 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-baa82622-b89b-456b-a610-dc2dc07c190e tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Flavor limits 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 12:01:41.009413 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-baa82622-b89b-456b-a610-dc2dc07c190e tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Image limits 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 12:01:41.010130 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-baa82622-b89b-456b-a610-dc2dc07c190e tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Flavor pref 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 12:01:41.010632 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-baa82622-b89b-456b-a610-dc2dc07c190e tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Image pref 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 12:01:41.011039 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-baa82622-b89b-456b-a610-dc2dc07c190e tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 12:01:41.022618 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-baa82622-b89b-456b-a610-dc2dc07c190e tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:41.023341 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-baa82622-b89b-456b-a610-dc2dc07c190e tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:41.023778 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-baa82622-b89b-456b-a610-dc2dc07c190e tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:41.024572 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-baa82622-b89b-456b-a610-dc2dc07c190e tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:41.025247 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-baa82622-b89b-456b-a610-dc2dc07c190e tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:41.025865 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-baa82622-b89b-456b-a610-dc2dc07c190e tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:41.049617 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-baa82622-b89b-456b-a610-dc2dc07c190e tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Getting quotas for project f943e2a175344e40b29c72019ba95b03. Resources: {'ram', 'instances', 'cores'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 12:01:41.054852 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-baa82622-b89b-456b-a610-dc2dc07c190e tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Getting quotas for user ae372b81003e41aeb654da0bcca928d5 and project f943e2a175344e40b29c72019ba95b03. Resources: {'ram', 'instances', 'cores'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 12:01:41.068584 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-baa82622-b89b-456b-a610-dc2dc07c190e tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Going to run 1 instances... {{(pid=118994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 12:01:41.072877 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-baa82622-b89b-456b-a610-dc2dc07c190e tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09bcc8f8-a32f-4ec8-9ab2-a98964ad6a01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 12:01:41.130785 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-baa82622-b89b-456b-a610-dc2dc07c190e tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.726037 Oct 11 12:01:41.132501 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 94/198] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Oct 11 12:01:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 12:01:41.149428 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3fe0aba1-b2e0-49f2-a2b6-a2a0127e55f4 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:41.150361 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-3fe0aba1-b2e0-49f2-a2b6-a2a0127e55f4 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:41.243152 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-3fe0aba1-b2e0-49f2-a2b6-a2a0127e55f4 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:41.253096 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-3fe0aba1-b2e0-49f2-a2b6-a2a0127e55f4 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1214 microversion: 2.1 time: 0.107355 Oct 11 12:01:41.255186 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 105/199] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:41 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1214 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:41.373134 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-18f33803-d6ad-487a-a11a-4e9e557d65e1 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:41.374062 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-18f33803-d6ad-487a-a11a-4e9e557d65e1 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:41.382144 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-18f33803-d6ad-487a-a11a-4e9e557d65e1 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:41.382504 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-18f33803-d6ad-487a-a11a-4e9e557d65e1 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:41.382964 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-18f33803-d6ad-487a-a11a-4e9e557d65e1 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:41.383697 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-18f33803-d6ad-487a-a11a-4e9e557d65e1 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:41.384146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-18f33803-d6ad-487a-a11a-4e9e557d65e1 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:41.384815 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-18f33803-d6ad-487a-a11a-4e9e557d65e1 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:41.492230 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7b74b254-e6b0-4c4a-a11d-9359564072d5 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:41.493344 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7b74b254-e6b0-4c4a-a11d-9359564072d5 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:41.503906 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7b74b254-e6b0-4c4a-a11d-9359564072d5 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:41.504406 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7b74b254-e6b0-4c4a-a11d-9359564072d5 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:41.504859 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7b74b254-e6b0-4c4a-a11d-9359564072d5 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:41.505835 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7b74b254-e6b0-4c4a-a11d-9359564072d5 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:41.506714 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7b74b254-e6b0-4c4a-a11d-9359564072d5 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:41.507205 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7b74b254-e6b0-4c4a-a11d-9359564072d5 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:41.621042 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-18f33803-d6ad-487a-a11a-4e9e557d65e1 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:41.643380 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-18f33803-d6ad-487a-a11a-4e9e557d65e1 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1552 microversion: 2.1 time: 0.274392 Oct 11 12:01:41.645480 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 95/200] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:41 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1552 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:41.742955 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7b74b254-e6b0-4c4a-a11d-9359564072d5 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:41.754755 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7b74b254-e6b0-4c4a-a11d-9359564072d5 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1521 microversion: 2.1 time: 0.267922 Oct 11 12:01:41.755350 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 106/201] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:41 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:42.282822 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-dd9ab4c4-67ce-4e56-a9b6-1a59de954899 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:42.283556 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-dd9ab4c4-67ce-4e56-a9b6-1a59de954899 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:42.290040 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-dd9ab4c4-67ce-4e56-a9b6-1a59de954899 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:42.290530 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-dd9ab4c4-67ce-4e56-a9b6-1a59de954899 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:42.291023 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-dd9ab4c4-67ce-4e56-a9b6-1a59de954899 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:42.291726 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-dd9ab4c4-67ce-4e56-a9b6-1a59de954899 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:42.292170 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-dd9ab4c4-67ce-4e56-a9b6-1a59de954899 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:42.292576 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-dd9ab4c4-67ce-4e56-a9b6-1a59de954899 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:42.359939 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-dd9ab4c4-67ce-4e56-a9b6-1a59de954899 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:42.372466 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-dd9ab4c4-67ce-4e56-a9b6-1a59de954899 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1218 microversion: 2.1 time: 0.093560 Oct 11 12:01:42.373145 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 96/202] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:42 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1218 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:42.670847 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5543b742-dcd1-4a01-a912-f506e2d6e03d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:42.671438 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-5543b742-dcd1-4a01-a912-f506e2d6e03d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:42.678246 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5543b742-dcd1-4a01-a912-f506e2d6e03d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:42.678915 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5543b742-dcd1-4a01-a912-f506e2d6e03d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:42.679343 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5543b742-dcd1-4a01-a912-f506e2d6e03d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:42.680037 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5543b742-dcd1-4a01-a912-f506e2d6e03d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:42.680503 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5543b742-dcd1-4a01-a912-f506e2d6e03d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:42.681136 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5543b742-dcd1-4a01-a912-f506e2d6e03d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:42.798288 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-7a08c2c6-12aa-4d59-be9f-df5efeb504ef tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:42.799036 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-7a08c2c6-12aa-4d59-be9f-df5efeb504ef tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:42.805455 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7a08c2c6-12aa-4d59-be9f-df5efeb504ef tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:42.806116 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7a08c2c6-12aa-4d59-be9f-df5efeb504ef tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:42.806525 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7a08c2c6-12aa-4d59-be9f-df5efeb504ef tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:42.807523 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7a08c2c6-12aa-4d59-be9f-df5efeb504ef tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:42.808133 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7a08c2c6-12aa-4d59-be9f-df5efeb504ef tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:42.808491 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7a08c2c6-12aa-4d59-be9f-df5efeb504ef tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:42.842351 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5543b742-dcd1-4a01-a912-f506e2d6e03d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:42.851850 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5543b742-dcd1-4a01-a912-f506e2d6e03d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1552 microversion: 2.1 time: 0.186117 Oct 11 12:01:42.852435 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 107/203] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:42 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1552 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:01:42.996181 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-7a08c2c6-12aa-4d59-be9f-df5efeb504ef tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:43.007105 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-7a08c2c6-12aa-4d59-be9f-df5efeb504ef tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1521 microversion: 2.1 time: 0.213322 Oct 11 12:01:43.007808 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 97/204] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:42 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:01:43.396071 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d3c88582-2607-4530-b7fe-f7b83406ebec tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:43.396708 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d3c88582-2607-4530-b7fe-f7b83406ebec tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:43.403875 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d3c88582-2607-4530-b7fe-f7b83406ebec tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:43.404355 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d3c88582-2607-4530-b7fe-f7b83406ebec tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:43.404767 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d3c88582-2607-4530-b7fe-f7b83406ebec tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:43.405517 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d3c88582-2607-4530-b7fe-f7b83406ebec tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:43.405900 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d3c88582-2607-4530-b7fe-f7b83406ebec tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:43.406490 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d3c88582-2607-4530-b7fe-f7b83406ebec tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:43.470412 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d3c88582-2607-4530-b7fe-f7b83406ebec tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:43.478795 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d3c88582-2607-4530-b7fe-f7b83406ebec tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1218 microversion: 2.1 time: 0.086455 Oct 11 12:01:43.479387 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 108/205] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:43 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:43.875447 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-27bdebce-38ae-4991-9650-95239c0ae87d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:43.876081 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-27bdebce-38ae-4991-9650-95239c0ae87d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:43.882292 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-27bdebce-38ae-4991-9650-95239c0ae87d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:43.882809 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-27bdebce-38ae-4991-9650-95239c0ae87d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:43.883267 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-27bdebce-38ae-4991-9650-95239c0ae87d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:43.883958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-27bdebce-38ae-4991-9650-95239c0ae87d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:43.884396 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-27bdebce-38ae-4991-9650-95239c0ae87d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:43.884805 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-27bdebce-38ae-4991-9650-95239c0ae87d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:44.031001 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-27bdebce-38ae-4991-9650-95239c0ae87d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:44.031770 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-abce8739-58a2-4e1f-9374-0834c9a99b7e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:44.032380 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-abce8739-58a2-4e1f-9374-0834c9a99b7e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:44.041746 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-abce8739-58a2-4e1f-9374-0834c9a99b7e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:44.042541 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-abce8739-58a2-4e1f-9374-0834c9a99b7e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:44.043302 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-abce8739-58a2-4e1f-9374-0834c9a99b7e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:44.044500 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-abce8739-58a2-4e1f-9374-0834c9a99b7e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:44.045251 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-abce8739-58a2-4e1f-9374-0834c9a99b7e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:44.045503 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-27bdebce-38ae-4991-9650-95239c0ae87d tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1552 microversion: 2.1 time: 0.173566 Oct 11 12:01:44.045953 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-abce8739-58a2-4e1f-9374-0834c9a99b7e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:44.046464 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 98/206] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:43 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1552 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:44.198981 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-abce8739-58a2-4e1f-9374-0834c9a99b7e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:44.208231 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-abce8739-58a2-4e1f-9374-0834c9a99b7e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1521 microversion: 2.1 time: 0.180199 Oct 11 12:01:44.208887 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 109/207] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:44 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:01:44.502638 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-b37ad40d-6370-41d5-8b53-89a1110bba56 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:44.503362 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-b37ad40d-6370-41d5-8b53-89a1110bba56 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:44.510883 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b37ad40d-6370-41d5-8b53-89a1110bba56 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:44.511368 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b37ad40d-6370-41d5-8b53-89a1110bba56 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:44.511797 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b37ad40d-6370-41d5-8b53-89a1110bba56 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:44.512533 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b37ad40d-6370-41d5-8b53-89a1110bba56 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:44.513022 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b37ad40d-6370-41d5-8b53-89a1110bba56 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:44.513389 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b37ad40d-6370-41d5-8b53-89a1110bba56 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:44.581952 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-b37ad40d-6370-41d5-8b53-89a1110bba56 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:44.590098 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-b37ad40d-6370-41d5-8b53-89a1110bba56 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1218 microversion: 2.1 time: 0.091945 Oct 11 12:01:44.590714 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 99/208] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:44 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:45.084399 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c2857c19-dfb7-4846-83d8-15b24fd59348 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:45.085008 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c2857c19-dfb7-4846-83d8-15b24fd59348 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:45.091994 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c2857c19-dfb7-4846-83d8-15b24fd59348 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:45.092480 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c2857c19-dfb7-4846-83d8-15b24fd59348 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:45.093116 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c2857c19-dfb7-4846-83d8-15b24fd59348 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:45.093879 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c2857c19-dfb7-4846-83d8-15b24fd59348 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:45.094335 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c2857c19-dfb7-4846-83d8-15b24fd59348 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:45.094948 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c2857c19-dfb7-4846-83d8-15b24fd59348 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:45.237963 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-6f62bf99-34b9-443c-82cb-6cf30347fb02 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:45.238931 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-6f62bf99-34b9-443c-82cb-6cf30347fb02 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:45.260095 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6f62bf99-34b9-443c-82cb-6cf30347fb02 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:45.260615 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6f62bf99-34b9-443c-82cb-6cf30347fb02 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:45.261051 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6f62bf99-34b9-443c-82cb-6cf30347fb02 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:45.261817 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6f62bf99-34b9-443c-82cb-6cf30347fb02 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:45.262353 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6f62bf99-34b9-443c-82cb-6cf30347fb02 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:45.266931 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6f62bf99-34b9-443c-82cb-6cf30347fb02 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:45.542472 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-6f62bf99-34b9-443c-82cb-6cf30347fb02 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:45.551667 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-6f62bf99-34b9-443c-82cb-6cf30347fb02 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1521 microversion: 2.1 time: 0.321552 Oct 11 12:01:45.552527 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 100/209] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:45 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:01:45.615662 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-76dddf99-1578-4778-b53a-4940db45d916 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:45.616869 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-76dddf99-1578-4778-b53a-4940db45d916 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:45.627899 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-76dddf99-1578-4778-b53a-4940db45d916 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:45.628724 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-76dddf99-1578-4778-b53a-4940db45d916 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:45.629765 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-76dddf99-1578-4778-b53a-4940db45d916 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:45.631640 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-76dddf99-1578-4778-b53a-4940db45d916 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:45.632861 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-76dddf99-1578-4778-b53a-4940db45d916 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:45.635105 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-76dddf99-1578-4778-b53a-4940db45d916 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:45.771546 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c2857c19-dfb7-4846-83d8-15b24fd59348 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:45.771789 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-76dddf99-1578-4778-b53a-4940db45d916 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:45.782815 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c2857c19-dfb7-4846-83d8-15b24fd59348 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1552 microversion: 2.1 time: 0.702300 Oct 11 12:01:45.783832 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 110/210] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:45 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1552 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:01:45.784231 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-76dddf99-1578-4778-b53a-4940db45d916 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1266 microversion: 2.1 time: 0.173536 Oct 11 12:01:45.800051 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 101/211] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:45 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1266 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:01:46.523322 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-0c28ff8c-7947-44d5-a82e-c84d3f691a07 req-12eb3eb5-fa7e-491e-9851-c2ba4e5dae5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c49bf4e1-912c-47b2-9761-88325bf6d533", "name": "network-vif-deleted", "tag": "9d2064c6-cfc0-4a34-a19a-dfcb06301457"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:01:46.560971 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-0c28ff8c-7947-44d5-a82e-c84d3f691a07 req-12eb3eb5-fa7e-491e-9851-c2ba4e5dae5f service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:46.561480 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-0c28ff8c-7947-44d5-a82e-c84d3f691a07 req-12eb3eb5-fa7e-491e-9851-c2ba4e5dae5f service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:46.561976 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-0c28ff8c-7947-44d5-a82e-c84d3f691a07 req-12eb3eb5-fa7e-491e-9851-c2ba4e5dae5f service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:46.580282 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-4c871e2b-e6c6-4a0d-b6b2-f782ac6649f2 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:46.582333 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-4c871e2b-e6c6-4a0d-b6b2-f782ac6649f2 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:46.597275 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-0c28ff8c-7947-44d5-a82e-c84d3f691a07 req-12eb3eb5-fa7e-491e-9851-c2ba4e5dae5f service nova] Creating event network-vif-deleted:9d2064c6-cfc0-4a34-a19a-dfcb06301457 for instance c49bf4e1-912c-47b2-9761-88325bf6d533 on hv-cinder-82099 Oct 11 12:01:46.606411 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4c871e2b-e6c6-4a0d-b6b2-f782ac6649f2 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:46.608805 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4c871e2b-e6c6-4a0d-b6b2-f782ac6649f2 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:46.615116 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-0c28ff8c-7947-44d5-a82e-c84d3f691a07 req-12eb3eb5-fa7e-491e-9851-c2ba4e5dae5f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096727 Oct 11 12:01:46.617067 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 111/212] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:01:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:01:46.619689 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4c871e2b-e6c6-4a0d-b6b2-f782ac6649f2 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:46.623309 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4c871e2b-e6c6-4a0d-b6b2-f782ac6649f2 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:46.628359 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4c871e2b-e6c6-4a0d-b6b2-f782ac6649f2 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:46.629094 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4c871e2b-e6c6-4a0d-b6b2-f782ac6649f2 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:46.822424 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2f0b1978-a8ac-4021-8018-b713cb2ab226 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:46.824473 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2f0b1978-a8ac-4021-8018-b713cb2ab226 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:46.839527 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2f0b1978-a8ac-4021-8018-b713cb2ab226 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:46.840393 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2f0b1978-a8ac-4021-8018-b713cb2ab226 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:46.841579 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2f0b1978-a8ac-4021-8018-b713cb2ab226 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:46.843167 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2f0b1978-a8ac-4021-8018-b713cb2ab226 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:46.844475 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2f0b1978-a8ac-4021-8018-b713cb2ab226 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:46.846391 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2f0b1978-a8ac-4021-8018-b713cb2ab226 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:46.882016 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-4c871e2b-e6c6-4a0d-b6b2-f782ac6649f2 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:46.893875 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-4c871e2b-e6c6-4a0d-b6b2-f782ac6649f2 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1521 microversion: 2.1 time: 0.320781 Oct 11 12:01:46.894758 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 102/213] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:46 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1521 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:01:46.900627 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-95ec1f5e-0923-49b7-a278-0f64006922a5 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:46.901939 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-95ec1f5e-0923-49b7-a278-0f64006922a5 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:46.909627 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-95ec1f5e-0923-49b7-a278-0f64006922a5 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:46.910804 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-95ec1f5e-0923-49b7-a278-0f64006922a5 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:46.911489 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-95ec1f5e-0923-49b7-a278-0f64006922a5 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:46.912570 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-95ec1f5e-0923-49b7-a278-0f64006922a5 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:46.913248 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-95ec1f5e-0923-49b7-a278-0f64006922a5 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:46.913911 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-95ec1f5e-0923-49b7-a278-0f64006922a5 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:46.993503 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-95ec1f5e-0923-49b7-a278-0f64006922a5 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:47.003879 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-95ec1f5e-0923-49b7-a278-0f64006922a5 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1272 microversion: 2.1 time: 0.107637 Oct 11 12:01:47.005107 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 103/214] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:46 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1272 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:47.033954 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2f0b1978-a8ac-4021-8018-b713cb2ab226 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1619ed83ae546a7ac2219c055ca4076', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbb66bfd69114f489c0bced30cc1b0b9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:47.044824 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2f0b1978-a8ac-4021-8018-b713cb2ab226 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 200 len: 1345 microversion: 2.1 time: 0.232006 Oct 11 12:01:47.045784 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 112/215] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:46 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 1345 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:47.947521 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-98a33047-d2fc-46bf-89ca-644cad94cc85 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:47.949520 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-98a33047-d2fc-46bf-89ca-644cad94cc85 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:47.961189 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-98a33047-d2fc-46bf-89ca-644cad94cc85 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:47.961683 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-98a33047-d2fc-46bf-89ca-644cad94cc85 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:47.962116 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-98a33047-d2fc-46bf-89ca-644cad94cc85 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:47.964137 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-98a33047-d2fc-46bf-89ca-644cad94cc85 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:47.965892 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-98a33047-d2fc-46bf-89ca-644cad94cc85 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:47.966917 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-98a33047-d2fc-46bf-89ca-644cad94cc85 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:48.029992 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3f548bae-761f-4235-be76-b80f5050f966 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:48.030810 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-3f548bae-761f-4235-be76-b80f5050f966 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:48.051619 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3f548bae-761f-4235-be76-b80f5050f966 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:48.052033 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3f548bae-761f-4235-be76-b80f5050f966 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:48.052636 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3f548bae-761f-4235-be76-b80f5050f966 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:48.053348 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3f548bae-761f-4235-be76-b80f5050f966 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:48.053965 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3f548bae-761f-4235-be76-b80f5050f966 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:48.054627 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3f548bae-761f-4235-be76-b80f5050f966 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:48.384234 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-98a33047-d2fc-46bf-89ca-644cad94cc85 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:48.393837 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-98a33047-d2fc-46bf-89ca-644cad94cc85 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1521 microversion: 2.1 time: 0.450233 Oct 11 12:01:48.394840 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 104/216] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:47 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1521 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:01:48.399963 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-bd4dc3f0-f8a9-4add-9b2a-f41cab9528c0 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:48.400880 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-bd4dc3f0-f8a9-4add-9b2a-f41cab9528c0 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:48.412684 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bd4dc3f0-f8a9-4add-9b2a-f41cab9528c0 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:48.413505 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bd4dc3f0-f8a9-4add-9b2a-f41cab9528c0 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:48.415784 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bd4dc3f0-f8a9-4add-9b2a-f41cab9528c0 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:48.416868 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bd4dc3f0-f8a9-4add-9b2a-f41cab9528c0 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:48.418469 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bd4dc3f0-f8a9-4add-9b2a-f41cab9528c0 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:48.419132 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bd4dc3f0-f8a9-4add-9b2a-f41cab9528c0 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:48.446381 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.wsgi [None req-bd4dc3f0-f8a9-4add-9b2a-f41cab9528c0 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] HTTP exception thrown: Instance c49bf4e1-912c-47b2-9761-88325bf6d533 could not be found. Oct 11 12:01:48.456823 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-bd4dc3f0-f8a9-4add-9b2a-f41cab9528c0 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Request method failure captured: Oct 11 12:01:48.456823 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: request: GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 HTTP/1.1 Oct 11 12:01:48.456823 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept: application/json Oct 11 12:01:48.456823 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept-Encoding: identity Oct 11 12:01:48.456823 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Connection: close Oct 11 12:01:48.456823 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Length: 0 Oct 11 12:01:48.456823 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Type: application/json Oct 11 12:01:48.456823 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Host: 10.222.0.59 Oct 11 12:01:48.456823 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Openstack-System-Scope: None Oct 11 12:01:48.456823 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: User-Agent: python-urllib3/1.26.12 Oct 11 12:01:48.456823 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Auth-Token: gAAAAABjRVrF3xatWkYmNydBWRRKLqRPFsro83YD1d4unGLBVGHudNih4gs9UL5RLUxnKNnexEe84X2HzLoPDrk4iSxSQ_bZJNqiNC8I6qLwuRedLmKRfYI9YDRGadhrQdqXFqD4XuwkfYLUWLVdV4zVUXwFU7bTnpC24Q9na7NQE8NcyMpk80Y Oct 11 12:01:48.456823 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Id: None Oct 11 12:01:48.456823 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Name: None Oct 11 12:01:48.456823 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Identity-Status: Confirmed Oct 11 12:01:48.456823 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Is-Admin-Project: True Oct 11 12:01:48.456823 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Id: default Oct 11 12:01:48.456823 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Name: Default Oct 11 12:01:48.456823 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Id: bbb66bfd69114f489c0bced30cc1b0b9 Oct 11 12:01:48.456823 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Name: tempest-DeleteServersTestJSON-1424225544 Oct 11 12:01:48.456823 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Role: reader,member Oct 11 12:01:48.456823 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Roles: reader,member Oct 11 12:01:48.458733 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bbb66bfd69114f489c0bced30cc1b0b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bbb66bfd69114f489c0bced30cc1b0b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bbb66bfd69114f489c0bced30cc1b0b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bbb66bfd69114f489c0bced30cc1b0b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:01:48.458733 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant: tempest-DeleteServersTestJSON-1424225544 Oct 11 12:01:48.458733 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Id: bbb66bfd69114f489c0bced30cc1b0b9 Oct 11 12:01:48.458733 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Name: tempest-DeleteServersTestJSON-1424225544 Oct 11 12:01:48.458733 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User: tempest-DeleteServersTestJSON-1424225544-project Oct 11 12:01:48.458733 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Id: default Oct 11 12:01:48.458733 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Name: Default Oct 11 12:01:48.458733 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Id: d1619ed83ae546a7ac2219c055ca4076 Oct 11 12:01:48.458733 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Name: tempest-DeleteServersTestJSON-1424225544-project Oct 11 12:01:48.458733 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: method: > Oct 11 12:01:48.458733 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: exception: Instance c49bf4e1-912c-47b2-9761-88325bf6d533 could not be found. Oct 11 12:01:48.458733 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: action_args: {'id': 'c49bf4e1-912c-47b2-9761-88325bf6d533'} Oct 11 12:01:48.460189 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:01:48.460189 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:01:48.460189 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:01:48.460189 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:01:48.460189 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:01:48.460189 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:01:48.460189 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:01:48.460189 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:01:48.460189 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:01:48.460189 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:01:48.460189 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c49bf4e1-912c-47b2-9761-88325bf6d533 could not be found. Oct 11 12:01:48.460189 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:01:48.460189 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:01:48.460189 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:01:48.460189 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:01:48.460189 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:01:48.460189 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:01:48.460189 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:01:48.460189 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:01:48.460189 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:01:48.461336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:01:48.461336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 12:01:48.461336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 12:01:48.461336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:01:48.461336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:01:48.461336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:01:48.461336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:01:48.461336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c49bf4e1-912c-47b2-9761-88325bf6d533 could not be found. Oct 11 12:01:48.461336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:01:48.461336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:01:48.461336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:01:48.461336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:01:48.461336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:01:48.461336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:01:48.461336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:01:48.461336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:01:48.461336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c49bf4e1-912c-47b2-9761-88325bf6d533 could not be found. Oct 11 12:01:48.461336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:01:48.462309 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-bd4dc3f0-f8a9-4add-9b2a-f41cab9528c0 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Returning 404 to user: Instance c49bf4e1-912c-47b2-9761-88325bf6d533 could not be found. {{(pid=118994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:01:48.462309 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-bd4dc3f0-f8a9-4add-9b2a-f41cab9528c0 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 404 len: 111 microversion: 2.1 time: 0.061858 Oct 11 12:01:48.462309 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 105/217] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:48 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:01:48.490139 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-3f548bae-761f-4235-be76-b80f5050f966 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:48.549710 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-3f548bae-761f-4235-be76-b80f5050f966 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1314 microversion: 2.1 time: 0.523218 Oct 11 12:01:48.562096 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 113/218] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:48 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1314 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:48.640589 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-6d8c6639-6c20-48cf-8009-398c6f681003 req-ba1c840b-2866-41ba-ba0b-362661e25864 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4f4546a4-8930-4f69-8f88-e4b23dc9d21c", "tag": "09a5433d-8875-4b65-bf36-ec574c211097"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:01:48.655236 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-6d8c6639-6c20-48cf-8009-398c6f681003 req-ba1c840b-2866-41ba-ba0b-362661e25864 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:48.656551 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-6d8c6639-6c20-48cf-8009-398c6f681003 req-ba1c840b-2866-41ba-ba0b-362661e25864 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:48.657372 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-6d8c6639-6c20-48cf-8009-398c6f681003 req-ba1c840b-2866-41ba-ba0b-362661e25864 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:48.677840 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-6d8c6639-6c20-48cf-8009-398c6f681003 req-ba1c840b-2866-41ba-ba0b-362661e25864 service nova] Creating event network-changed:09a5433d-8875-4b65-bf36-ec574c211097 for instance 4f4546a4-8930-4f69-8f88-e4b23dc9d21c on hv-cinder-82099 Oct 11 12:01:48.685108 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-6d8c6639-6c20-48cf-8009-398c6f681003 req-ba1c840b-2866-41ba-ba0b-362661e25864 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050775 Oct 11 12:01:48.686910 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c6256e60-7179-48da-a5a9-d9115345d09c tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:48.689396 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 106/219] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:01:48.692535 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c6256e60-7179-48da-a5a9-d9115345d09c tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:48.704315 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c6256e60-7179-48da-a5a9-d9115345d09c tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:48.704955 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c6256e60-7179-48da-a5a9-d9115345d09c tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:48.705462 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c6256e60-7179-48da-a5a9-d9115345d09c tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:48.706226 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c6256e60-7179-48da-a5a9-d9115345d09c tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:48.706714 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c6256e60-7179-48da-a5a9-d9115345d09c tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:48.707154 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c6256e60-7179-48da-a5a9-d9115345d09c tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:48.727093 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-c6256e60-7179-48da-a5a9-d9115345d09c tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] HTTP exception thrown: Instance c49bf4e1-912c-47b2-9761-88325bf6d533 could not be found. Oct 11 12:01:48.733452 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c6256e60-7179-48da-a5a9-d9115345d09c tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Request method failure captured: Oct 11 12:01:48.733452 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533/os-volume_attachments HTTP/1.1 Oct 11 12:01:48.733452 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 11 12:01:48.733452 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 11 12:01:48.733452 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Connection: close Oct 11 12:01:48.733452 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 11 12:01:48.733452 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 11 12:01:48.733452 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Host: 10.222.0.59 Oct 11 12:01:48.733452 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 11 12:01:48.733452 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 11 12:01:48.733452 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjRVrF3xatWkYmNydBWRRKLqRPFsro83YD1d4unGLBVGHudNih4gs9UL5RLUxnKNnexEe84X2HzLoPDrk4iSxSQ_bZJNqiNC8I6qLwuRedLmKRfYI9YDRGadhrQdqXFqD4XuwkfYLUWLVdV4zVUXwFU7bTnpC24Q9na7NQE8NcyMpk80Y Oct 11 12:01:48.733452 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 11 12:01:48.733452 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 11 12:01:48.733452 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 11 12:01:48.733452 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 11 12:01:48.733452 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 11 12:01:48.733452 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 11 12:01:48.733452 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Id: bbb66bfd69114f489c0bced30cc1b0b9 Oct 11 12:01:48.733452 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-DeleteServersTestJSON-1424225544 Oct 11 12:01:48.733452 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Role: reader,member Oct 11 12:01:48.733452 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Roles: reader,member Oct 11 12:01:48.735239 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bbb66bfd69114f489c0bced30cc1b0b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bbb66bfd69114f489c0bced30cc1b0b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bbb66bfd69114f489c0bced30cc1b0b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bbb66bfd69114f489c0bced30cc1b0b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:01:48.735239 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-DeleteServersTestJSON-1424225544 Oct 11 12:01:48.735239 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Id: bbb66bfd69114f489c0bced30cc1b0b9 Oct 11 12:01:48.735239 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-DeleteServersTestJSON-1424225544 Oct 11 12:01:48.735239 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User: tempest-DeleteServersTestJSON-1424225544-project Oct 11 12:01:48.735239 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 11 12:01:48.735239 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 11 12:01:48.735239 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Id: d1619ed83ae546a7ac2219c055ca4076 Oct 11 12:01:48.735239 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-DeleteServersTestJSON-1424225544-project Oct 11 12:01:48.735239 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: method: > Oct 11 12:01:48.735239 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: exception: Instance c49bf4e1-912c-47b2-9761-88325bf6d533 could not be found. Oct 11 12:01:48.735239 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: action_args: {'server_id': 'c49bf4e1-912c-47b2-9761-88325bf6d533'} Oct 11 12:01:48.736068 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:01:48.736068 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:01:48.736068 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:01:48.736068 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:01:48.736068 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:01:48.736068 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:01:48.736068 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:01:48.736068 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:01:48.736068 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:01:48.736068 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:01:48.736068 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c49bf4e1-912c-47b2-9761-88325bf6d533 could not be found. Oct 11 12:01:48.736068 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:01:48.736068 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:01:48.736068 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:01:48.736068 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:01:48.736068 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:01:48.736068 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:01:48.736068 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:01:48.736068 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:01:48.736068 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:01:48.737153 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:01:48.737153 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 12:01:48.737153 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 12:01:48.737153 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 12:01:48.737153 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 12:01:48.737153 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 11 12:01:48.737153 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 11 12:01:48.737153 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:01:48.737153 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:01:48.737153 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c49bf4e1-912c-47b2-9761-88325bf6d533 could not be found. Oct 11 12:01:48.737153 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:01:48.737153 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:01:48.737153 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:01:48.737153 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:01:48.737153 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:01:48.737153 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:01:48.737153 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:01:48.737153 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:01:48.737153 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c49bf4e1-912c-47b2-9761-88325bf6d533 could not be found. Oct 11 12:01:48.737153 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:01:48.738309 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c6256e60-7179-48da-a5a9-d9115345d09c tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Returning 404 to user: Instance c49bf4e1-912c-47b2-9761-88325bf6d533 could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:01:48.738309 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c6256e60-7179-48da-a5a9-d9115345d09c tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.062625 Oct 11 12:01:48.738309 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 114/220] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Oct 11 12:01:48 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533/os-volume_attachments => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:01:49.436100 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-6bef8079-fa48-4956-8745-d79f2eb679ae tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:49.437084 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-6bef8079-fa48-4956-8745-d79f2eb679ae tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:49.446588 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6bef8079-fa48-4956-8745-d79f2eb679ae tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:49.447515 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6bef8079-fa48-4956-8745-d79f2eb679ae tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:49.448207 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6bef8079-fa48-4956-8745-d79f2eb679ae tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:49.449313 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6bef8079-fa48-4956-8745-d79f2eb679ae tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:49.450772 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6bef8079-fa48-4956-8745-d79f2eb679ae tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:49.451060 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6bef8079-fa48-4956-8745-d79f2eb679ae tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:49.604367 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-345ccd87-596e-40f2-8fe3-ec05034c3a06 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:49.612341 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-345ccd87-596e-40f2-8fe3-ec05034c3a06 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:49.634188 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-345ccd87-596e-40f2-8fe3-ec05034c3a06 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:49.635174 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-345ccd87-596e-40f2-8fe3-ec05034c3a06 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:49.636015 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-345ccd87-596e-40f2-8fe3-ec05034c3a06 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:49.647887 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-345ccd87-596e-40f2-8fe3-ec05034c3a06 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:49.669605 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-345ccd87-596e-40f2-8fe3-ec05034c3a06 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:49.671954 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-345ccd87-596e-40f2-8fe3-ec05034c3a06 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:49.752638 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-6bef8079-fa48-4956-8745-d79f2eb679ae tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:49.756319 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=100 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:49.763807 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-6bef8079-fa48-4956-8745-d79f2eb679ae tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1521 microversion: 2.1 time: 0.333805 Oct 11 12:01:49.774912 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 107/221] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:49 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:01:49.966382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-345ccd87-596e-40f2-8fe3-ec05034c3a06 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:49.988694 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-345ccd87-596e-40f2-8fe3-ec05034c3a06 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1314 microversion: 2.1 time: 0.403325 Oct 11 12:01:49.998720 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 115/222] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:49 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:50.036575 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-4d0964f3-5aec-4c40-80bf-bd25188db839 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:50.037386 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-4d0964f3-5aec-4c40-80bf-bd25188db839 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:50.047966 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4d0964f3-5aec-4c40-80bf-bd25188db839 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:50.049973 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4d0964f3-5aec-4c40-80bf-bd25188db839 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:50.050532 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4d0964f3-5aec-4c40-80bf-bd25188db839 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:50.051509 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4d0964f3-5aec-4c40-80bf-bd25188db839 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:50.052155 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4d0964f3-5aec-4c40-80bf-bd25188db839 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:50.052768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4d0964f3-5aec-4c40-80bf-bd25188db839 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:50.077373 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.wsgi [None req-4d0964f3-5aec-4c40-80bf-bd25188db839 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] HTTP exception thrown: Instance c49bf4e1-912c-47b2-9761-88325bf6d533 could not be found. Oct 11 12:01:50.079754 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-4d0964f3-5aec-4c40-80bf-bd25188db839 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Request method failure captured: Oct 11 12:01:50.079754 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: request: DELETE /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 HTTP/1.1 Oct 11 12:01:50.079754 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept: application/json Oct 11 12:01:50.079754 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept-Encoding: identity Oct 11 12:01:50.079754 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Connection: close Oct 11 12:01:50.079754 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Length: 0 Oct 11 12:01:50.079754 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Type: application/json Oct 11 12:01:50.079754 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Host: 10.222.0.59 Oct 11 12:01:50.079754 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Openstack-System-Scope: None Oct 11 12:01:50.079754 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: User-Agent: python-urllib3/1.26.12 Oct 11 12:01:50.079754 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Auth-Token: gAAAAABjRVrF3xatWkYmNydBWRRKLqRPFsro83YD1d4unGLBVGHudNih4gs9UL5RLUxnKNnexEe84X2HzLoPDrk4iSxSQ_bZJNqiNC8I6qLwuRedLmKRfYI9YDRGadhrQdqXFqD4XuwkfYLUWLVdV4zVUXwFU7bTnpC24Q9na7NQE8NcyMpk80Y Oct 11 12:01:50.079754 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Id: None Oct 11 12:01:50.079754 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Name: None Oct 11 12:01:50.079754 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Identity-Status: Confirmed Oct 11 12:01:50.079754 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Is-Admin-Project: True Oct 11 12:01:50.079754 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Id: default Oct 11 12:01:50.079754 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Name: Default Oct 11 12:01:50.079754 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Id: bbb66bfd69114f489c0bced30cc1b0b9 Oct 11 12:01:50.079754 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Name: tempest-DeleteServersTestJSON-1424225544 Oct 11 12:01:50.079754 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Role: reader,member Oct 11 12:01:50.079754 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Roles: reader,member Oct 11 12:01:50.081213 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bbb66bfd69114f489c0bced30cc1b0b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bbb66bfd69114f489c0bced30cc1b0b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bbb66bfd69114f489c0bced30cc1b0b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bbb66bfd69114f489c0bced30cc1b0b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:01:50.081213 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant: tempest-DeleteServersTestJSON-1424225544 Oct 11 12:01:50.081213 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Id: bbb66bfd69114f489c0bced30cc1b0b9 Oct 11 12:01:50.081213 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Name: tempest-DeleteServersTestJSON-1424225544 Oct 11 12:01:50.081213 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User: tempest-DeleteServersTestJSON-1424225544-project Oct 11 12:01:50.081213 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Id: default Oct 11 12:01:50.081213 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Name: Default Oct 11 12:01:50.081213 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Id: d1619ed83ae546a7ac2219c055ca4076 Oct 11 12:01:50.081213 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Name: tempest-DeleteServersTestJSON-1424225544-project Oct 11 12:01:50.081213 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: method: > Oct 11 12:01:50.081213 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: exception: Instance c49bf4e1-912c-47b2-9761-88325bf6d533 could not be found. Oct 11 12:01:50.081213 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: action_args: {'id': 'c49bf4e1-912c-47b2-9761-88325bf6d533'} Oct 11 12:01:50.082013 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:01:50.082013 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:01:50.082013 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:01:50.082013 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:01:50.082013 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:01:50.082013 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:01:50.082013 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:01:50.082013 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:01:50.082013 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:01:50.082013 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:01:50.082013 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c49bf4e1-912c-47b2-9761-88325bf6d533 could not be found. Oct 11 12:01:50.082013 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:01:50.082013 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:01:50.082013 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:01:50.082013 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:01:50.082013 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:01:50.082013 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:01:50.082013 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:01:50.082013 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:01:50.082013 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:01:50.083305 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:01:50.083305 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 12:01:50.083305 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 12:01:50.083305 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 12:01:50.083305 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 12:01:50.083305 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:01:50.083305 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:01:50.083305 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:01:50.083305 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:01:50.083305 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c49bf4e1-912c-47b2-9761-88325bf6d533 could not be found. Oct 11 12:01:50.083305 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:01:50.083305 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:01:50.083305 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:01:50.083305 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:01:50.083305 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:01:50.083305 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:01:50.083305 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:01:50.083305 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:01:50.083305 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c49bf4e1-912c-47b2-9761-88325bf6d533 could not be found. Oct 11 12:01:50.083305 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:01:50.084518 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-4d0964f3-5aec-4c40-80bf-bd25188db839 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Returning 404 to user: Instance c49bf4e1-912c-47b2-9761-88325bf6d533 could not be found. {{(pid=118994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:01:50.084902 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-4d0964f3-5aec-4c40-80bf-bd25188db839 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 404 len: 111 microversion: 2.1 time: 0.052825 Oct 11 12:01:50.086011 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 108/223] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Oct 11 12:01:50 2022] DELETE /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:01:50.095750 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7c4406b7-050c-4ff9-8854-7f897ff330c9 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:50.096906 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7c4406b7-050c-4ff9-8854-7f897ff330c9 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] [instance: c49bf4e1-912c-47b2-9761-88325bf6d533] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:50.112316 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c4406b7-050c-4ff9-8854-7f897ff330c9 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:50.113223 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c4406b7-050c-4ff9-8854-7f897ff330c9 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:50.114184 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c4406b7-050c-4ff9-8854-7f897ff330c9 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:50.115335 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c4406b7-050c-4ff9-8854-7f897ff330c9 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:50.119176 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c4406b7-050c-4ff9-8854-7f897ff330c9 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:50.119673 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c4406b7-050c-4ff9-8854-7f897ff330c9 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:50.132569 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:50.163133 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-7c4406b7-050c-4ff9-8854-7f897ff330c9 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] HTTP exception thrown: Instance c49bf4e1-912c-47b2-9761-88325bf6d533 could not be found. Oct 11 12:01:50.165901 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7c4406b7-050c-4ff9-8854-7f897ff330c9 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Request method failure captured: Oct 11 12:01:50.165901 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 HTTP/1.1 Oct 11 12:01:50.165901 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 11 12:01:50.165901 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 11 12:01:50.165901 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Connection: close Oct 11 12:01:50.165901 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 11 12:01:50.165901 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 11 12:01:50.165901 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Host: 10.222.0.59 Oct 11 12:01:50.165901 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 11 12:01:50.165901 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 11 12:01:50.165901 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjRVrF3xatWkYmNydBWRRKLqRPFsro83YD1d4unGLBVGHudNih4gs9UL5RLUxnKNnexEe84X2HzLoPDrk4iSxSQ_bZJNqiNC8I6qLwuRedLmKRfYI9YDRGadhrQdqXFqD4XuwkfYLUWLVdV4zVUXwFU7bTnpC24Q9na7NQE8NcyMpk80Y Oct 11 12:01:50.165901 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 11 12:01:50.165901 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 11 12:01:50.165901 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 11 12:01:50.165901 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 11 12:01:50.165901 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 11 12:01:50.165901 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 11 12:01:50.165901 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Id: bbb66bfd69114f489c0bced30cc1b0b9 Oct 11 12:01:50.165901 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-DeleteServersTestJSON-1424225544 Oct 11 12:01:50.165901 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Role: reader,member Oct 11 12:01:50.165901 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Roles: reader,member Oct 11 12:01:50.168140 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/bbb66bfd69114f489c0bced30cc1b0b9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_bbb66bfd69114f489c0bced30cc1b0b9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bbb66bfd69114f489c0bced30cc1b0b9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/bbb66bfd69114f489c0bced30cc1b0b9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:01:50.168140 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-DeleteServersTestJSON-1424225544 Oct 11 12:01:50.168140 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Id: bbb66bfd69114f489c0bced30cc1b0b9 Oct 11 12:01:50.168140 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-DeleteServersTestJSON-1424225544 Oct 11 12:01:50.168140 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User: tempest-DeleteServersTestJSON-1424225544-project Oct 11 12:01:50.168140 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 11 12:01:50.168140 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 11 12:01:50.168140 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Id: d1619ed83ae546a7ac2219c055ca4076 Oct 11 12:01:50.168140 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-DeleteServersTestJSON-1424225544-project Oct 11 12:01:50.168140 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: method: > Oct 11 12:01:50.168140 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: exception: Instance c49bf4e1-912c-47b2-9761-88325bf6d533 could not be found. Oct 11 12:01:50.168140 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: action_args: {'id': 'c49bf4e1-912c-47b2-9761-88325bf6d533'} Oct 11 12:01:50.169919 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:01:50.169919 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:01:50.169919 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:01:50.169919 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:01:50.169919 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:01:50.169919 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:01:50.169919 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:01:50.169919 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:01:50.169919 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:01:50.169919 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:01:50.169919 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c49bf4e1-912c-47b2-9761-88325bf6d533 could not be found. Oct 11 12:01:50.169919 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:01:50.169919 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:01:50.169919 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:01:50.169919 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:01:50.169919 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:01:50.169919 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:01:50.169919 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:01:50.169919 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:01:50.169919 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:01:50.171322 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:01:50.171322 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 12:01:50.171322 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 12:01:50.171322 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:01:50.171322 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:01:50.171322 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:01:50.171322 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:01:50.171322 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c49bf4e1-912c-47b2-9761-88325bf6d533 could not be found. Oct 11 12:01:50.171322 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:01:50.171322 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:01:50.171322 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:01:50.171322 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:01:50.171322 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:01:50.171322 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:01:50.171322 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:01:50.171322 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:01:50.171322 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c49bf4e1-912c-47b2-9761-88325bf6d533 could not be found. Oct 11 12:01:50.171322 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:01:50.174290 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7c4406b7-050c-4ff9-8854-7f897ff330c9 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] Returning 404 to user: Instance c49bf4e1-912c-47b2-9761-88325bf6d533 could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:01:50.174290 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7c4406b7-050c-4ff9-8854-7f897ff330c9 tempest-DeleteServersTestJSON-1424225544 tempest-DeleteServersTestJSON-1424225544-project] 10.222.0.59 "GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533" status: 404 len: 111 microversion: 2.1 time: 0.078069 Oct 11 12:01:50.175986 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 116/224] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:50 2022] GET /compute/v2.1/servers/c49bf4e1-912c-47b2-9761-88325bf6d533 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:01:50.795621 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-f1fd788d-6ce2-4297-8aff-4b527a37e152 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:50.803927 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-f1fd788d-6ce2-4297-8aff-4b527a37e152 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:50.821600 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f1fd788d-6ce2-4297-8aff-4b527a37e152 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:50.822723 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f1fd788d-6ce2-4297-8aff-4b527a37e152 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:50.823580 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f1fd788d-6ce2-4297-8aff-4b527a37e152 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:50.825084 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f1fd788d-6ce2-4297-8aff-4b527a37e152 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:50.827601 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f1fd788d-6ce2-4297-8aff-4b527a37e152 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:50.828694 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f1fd788d-6ce2-4297-8aff-4b527a37e152 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:51.027951 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b9f2609a-2e44-4467-b6c3-a08ffe59a6f1 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:51.028595 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-b9f2609a-2e44-4467-b6c3-a08ffe59a6f1 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:51.036610 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b9f2609a-2e44-4467-b6c3-a08ffe59a6f1 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:51.036852 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell0:SELECT=2 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:51.037139 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b9f2609a-2e44-4467-b6c3-a08ffe59a6f1 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:51.037744 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b9f2609a-2e44-4467-b6c3-a08ffe59a6f1 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:51.038484 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b9f2609a-2e44-4467-b6c3-a08ffe59a6f1 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:51.039169 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b9f2609a-2e44-4467-b6c3-a08ffe59a6f1 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:51.039578 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b9f2609a-2e44-4467-b6c3-a08ffe59a6f1 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:51.066588 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell0:SELECT=6 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:51.248426 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=2 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:01:51.276939 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-b9f2609a-2e44-4467-b6c3-a08ffe59a6f1 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:51.302363 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b9f2609a-2e44-4467-b6c3-a08ffe59a6f1 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1314 microversion: 2.1 time: 0.282319 Oct 11 12:01:51.315576 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 117/225] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:51 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:51.600565 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-f1fd788d-6ce2-4297-8aff-4b527a37e152 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:51.617047 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-f1fd788d-6ce2-4297-8aff-4b527a37e152 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1521 microversion: 2.1 time: 0.830755 Oct 11 12:01:51.631853 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 109/226] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:50 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1521 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:52.334706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7b13b0cd-bd30-44fb-9e9b-4b576dd7b9ac tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:52.336058 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7b13b0cd-bd30-44fb-9e9b-4b576dd7b9ac tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:52.343309 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7b13b0cd-bd30-44fb-9e9b-4b576dd7b9ac tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:52.343861 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7b13b0cd-bd30-44fb-9e9b-4b576dd7b9ac tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:52.344387 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7b13b0cd-bd30-44fb-9e9b-4b576dd7b9ac tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:52.345046 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7b13b0cd-bd30-44fb-9e9b-4b576dd7b9ac tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:52.347179 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7b13b0cd-bd30-44fb-9e9b-4b576dd7b9ac tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:52.347668 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7b13b0cd-bd30-44fb-9e9b-4b576dd7b9ac tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:52.647459 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-43172d6f-ced8-43c6-84fc-7990ed301f1a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:52.648154 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-43172d6f-ced8-43c6-84fc-7990ed301f1a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:52.672965 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-43172d6f-ced8-43c6-84fc-7990ed301f1a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:52.673263 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-43172d6f-ced8-43c6-84fc-7990ed301f1a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:52.678096 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-43172d6f-ced8-43c6-84fc-7990ed301f1a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:52.678947 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-43172d6f-ced8-43c6-84fc-7990ed301f1a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:52.691259 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-43172d6f-ced8-43c6-84fc-7990ed301f1a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:52.692727 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-43172d6f-ced8-43c6-84fc-7990ed301f1a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:52.847742 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7b13b0cd-bd30-44fb-9e9b-4b576dd7b9ac tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:52.857539 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7b13b0cd-bd30-44fb-9e9b-4b576dd7b9ac tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1314 microversion: 2.1 time: 0.531701 Oct 11 12:01:52.858142 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 118/227] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:52 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1314 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:53.117398 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-43172d6f-ced8-43c6-84fc-7990ed301f1a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:53.130950 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-43172d6f-ced8-43c6-84fc-7990ed301f1a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1501 microversion: 2.1 time: 0.487624 Oct 11 12:01:53.152768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 110/228] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:52 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1501 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:01:53.161710 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-729c1f48-ae6a-4f3b-8ed5-01c6c188e2dc tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:53.162379 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-729c1f48-ae6a-4f3b-8ed5-01c6c188e2dc tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:53.181851 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-729c1f48-ae6a-4f3b-8ed5-01c6c188e2dc tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:53.182437 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-729c1f48-ae6a-4f3b-8ed5-01c6c188e2dc tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:53.185412 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-729c1f48-ae6a-4f3b-8ed5-01c6c188e2dc tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:53.186875 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-729c1f48-ae6a-4f3b-8ed5-01c6c188e2dc tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:53.187906 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-729c1f48-ae6a-4f3b-8ed5-01c6c188e2dc tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:53.188364 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-729c1f48-ae6a-4f3b-8ed5-01c6c188e2dc tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:53.429313 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-729c1f48-ae6a-4f3b-8ed5-01c6c188e2dc tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:53.439148 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-729c1f48-ae6a-4f3b-8ed5-01c6c188e2dc tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1516 microversion: 2.1 time: 0.282634 Oct 11 12:01:53.440482 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 119/229] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:53 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1516 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:01:53.883153 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-a5672100-1db6-47f5-8bbf-e01b79271c33 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:53.885302 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-a5672100-1db6-47f5-8bbf-e01b79271c33 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:53.896962 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a5672100-1db6-47f5-8bbf-e01b79271c33 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:53.899279 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a5672100-1db6-47f5-8bbf-e01b79271c33 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:53.903432 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a5672100-1db6-47f5-8bbf-e01b79271c33 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:53.904550 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a5672100-1db6-47f5-8bbf-e01b79271c33 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:53.905611 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a5672100-1db6-47f5-8bbf-e01b79271c33 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:53.906389 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a5672100-1db6-47f5-8bbf-e01b79271c33 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:54.254574 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-a5672100-1db6-47f5-8bbf-e01b79271c33 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:54.270453 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-a5672100-1db6-47f5-8bbf-e01b79271c33 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1314 microversion: 2.1 time: 0.393010 Oct 11 12:01:54.282597 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 111/230] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:53 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:55.298645 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8d1813c0-c461-48fc-a2f1-2a8833c928ff tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:55.300008 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8d1813c0-c461-48fc-a2f1-2a8833c928ff tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:55.310911 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d1813c0-c461-48fc-a2f1-2a8833c928ff tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:55.311622 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d1813c0-c461-48fc-a2f1-2a8833c928ff tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:55.312399 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d1813c0-c461-48fc-a2f1-2a8833c928ff tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:55.313307 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d1813c0-c461-48fc-a2f1-2a8833c928ff tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:55.314865 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d1813c0-c461-48fc-a2f1-2a8833c928ff tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:55.316104 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d1813c0-c461-48fc-a2f1-2a8833c928ff tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:55.606985 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8d1813c0-c461-48fc-a2f1-2a8833c928ff tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:55.617109 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8d1813c0-c461-48fc-a2f1-2a8833c928ff tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1314 microversion: 2.1 time: 0.325486 Oct 11 12:01:55.618202 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 120/231] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:55 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:56.469599 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-e449e852-74de-4fa1-99ea-6bdd5ec5d15b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:01:56.474649 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-e449e852-74de-4fa1-99ea-6bdd5ec5d15b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:56.490949 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e449e852-74de-4fa1-99ea-6bdd5ec5d15b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:56.492283 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e449e852-74de-4fa1-99ea-6bdd5ec5d15b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:56.493210 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e449e852-74de-4fa1-99ea-6bdd5ec5d15b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:56.494382 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e449e852-74de-4fa1-99ea-6bdd5ec5d15b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:56.495228 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e449e852-74de-4fa1-99ea-6bdd5ec5d15b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:56.496117 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e449e852-74de-4fa1-99ea-6bdd5ec5d15b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:56.532491 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.objects.instance [None req-e449e852-74de-4fa1-99ea-6bdd5ec5d15b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lazy-loading 'flavor' on Instance uuid a6da2ee3-f7c1-4cab-a6bd-096baa684fca {{(pid=118994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:01:56.649348 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a457a1a0-6a90-40ce-84ff-ff8150847af5 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:56.655215 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a457a1a0-6a90-40ce-84ff-ff8150847af5 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:56.677017 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a457a1a0-6a90-40ce-84ff-ff8150847af5 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:56.680359 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a457a1a0-6a90-40ce-84ff-ff8150847af5 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:56.687314 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-e449e852-74de-4fa1-99ea-6bdd5ec5d15b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "POST /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca/action" status: 200 len: 32 microversion: 2.1 time: 0.227864 Oct 11 12:01:56.688479 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a457a1a0-6a90-40ce-84ff-ff8150847af5 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:56.689388 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a457a1a0-6a90-40ce-84ff-ff8150847af5 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:56.690466 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 112/232] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Oct 11 12:01:56 2022] POST /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca/action => generated 32 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 12:01:56.690706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a457a1a0-6a90-40ce-84ff-ff8150847af5 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:56.691380 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a457a1a0-6a90-40ce-84ff-ff8150847af5 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:56.725090 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-ee016791-ff2b-455e-be05-055405391f0b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:56.726322 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-ee016791-ff2b-455e-be05-055405391f0b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:56.736870 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ee016791-ff2b-455e-be05-055405391f0b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:56.738478 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ee016791-ff2b-455e-be05-055405391f0b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:56.739571 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ee016791-ff2b-455e-be05-055405391f0b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:56.741296 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ee016791-ff2b-455e-be05-055405391f0b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:56.742297 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ee016791-ff2b-455e-be05-055405391f0b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:56.743208 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ee016791-ff2b-455e-be05-055405391f0b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:57.241095 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a457a1a0-6a90-40ce-84ff-ff8150847af5 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:57.257421 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a457a1a0-6a90-40ce-84ff-ff8150847af5 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1314 microversion: 2.1 time: 0.615452 Oct 11 12:01:57.275081 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 121/233] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:56 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1314 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:57.339165 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-ee016791-ff2b-455e-be05-055405391f0b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:57.383937 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-ee016791-ff2b-455e-be05-055405391f0b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1522 microversion: 2.1 time: 0.664278 Oct 11 12:01:57.384992 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 113/234] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:56 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1522 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:58.289223 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5d1d4472-f64a-4be4-929e-d02a6a783642 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:58.291905 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-5d1d4472-f64a-4be4-929e-d02a6a783642 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:58.305415 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5d1d4472-f64a-4be4-929e-d02a6a783642 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:58.306250 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5d1d4472-f64a-4be4-929e-d02a6a783642 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:58.307303 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5d1d4472-f64a-4be4-929e-d02a6a783642 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:58.308254 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5d1d4472-f64a-4be4-929e-d02a6a783642 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:58.309943 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5d1d4472-f64a-4be4-929e-d02a6a783642 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:58.310712 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5d1d4472-f64a-4be4-929e-d02a6a783642 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:58.421340 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-4960ac5b-cd37-46d5-b7d4-2b8b3ef4d280 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:58.422395 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-4960ac5b-cd37-46d5-b7d4-2b8b3ef4d280 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:58.436578 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4960ac5b-cd37-46d5-b7d4-2b8b3ef4d280 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:58.437437 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4960ac5b-cd37-46d5-b7d4-2b8b3ef4d280 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:58.438140 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4960ac5b-cd37-46d5-b7d4-2b8b3ef4d280 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:58.439339 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4960ac5b-cd37-46d5-b7d4-2b8b3ef4d280 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:58.440057 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4960ac5b-cd37-46d5-b7d4-2b8b3ef4d280 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:58.440762 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4960ac5b-cd37-46d5-b7d4-2b8b3ef4d280 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:58.554732 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5d1d4472-f64a-4be4-929e-d02a6a783642 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:58.563874 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5d1d4472-f64a-4be4-929e-d02a6a783642 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1314 microversion: 2.1 time: 0.284341 Oct 11 12:01:58.564721 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 122/235] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:58 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:58.666033 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-4960ac5b-cd37-46d5-b7d4-2b8b3ef4d280 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:58.676955 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-4960ac5b-cd37-46d5-b7d4-2b8b3ef4d280 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1522 microversion: 2.1 time: 0.262516 Oct 11 12:01:58.677714 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 114/236] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:58 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:01:59.592524 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-58baf27f-9aab-4800-91dd-655ae509a062 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:59.593546 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-58baf27f-9aab-4800-91dd-655ae509a062 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:59.601927 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-58baf27f-9aab-4800-91dd-655ae509a062 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:59.602724 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-58baf27f-9aab-4800-91dd-655ae509a062 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:59.603161 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-58baf27f-9aab-4800-91dd-655ae509a062 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:59.603907 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-58baf27f-9aab-4800-91dd-655ae509a062 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:59.604373 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-58baf27f-9aab-4800-91dd-655ae509a062 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:59.604795 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-58baf27f-9aab-4800-91dd-655ae509a062 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:59.714038 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-d1c57a23-3f76-42f2-a46a-27d13e6b15b0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:01:59.715120 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-d1c57a23-3f76-42f2-a46a-27d13e6b15b0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:01:59.723381 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d1c57a23-3f76-42f2-a46a-27d13e6b15b0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:59.724123 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d1c57a23-3f76-42f2-a46a-27d13e6b15b0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:59.724709 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d1c57a23-3f76-42f2-a46a-27d13e6b15b0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:59.725558 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d1c57a23-3f76-42f2-a46a-27d13e6b15b0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:01:59.726251 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d1c57a23-3f76-42f2-a46a-27d13e6b15b0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:01:59.726910 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d1c57a23-3f76-42f2-a46a-27d13e6b15b0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:01:59.959738 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-58baf27f-9aab-4800-91dd-655ae509a062 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:01:59.978958 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-58baf27f-9aab-4800-91dd-655ae509a062 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1314 microversion: 2.1 time: 0.391504 Oct 11 12:01:59.980254 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 123/237] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:59 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1314 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:02:00.138333 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-d1c57a23-3f76-42f2-a46a-27d13e6b15b0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:00.183918 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-d1c57a23-3f76-42f2-a46a-27d13e6b15b0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1522 microversion: 2.1 time: 0.473957 Oct 11 12:02:00.185219 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 115/238] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:01:59 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1522 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:01.021460 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9a8a9d1e-bab7-4e59-a1e5-90b0472b7a9b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:01.022282 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9a8a9d1e-bab7-4e59-a1e5-90b0472b7a9b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:01.034589 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9a8a9d1e-bab7-4e59-a1e5-90b0472b7a9b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:01.035425 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9a8a9d1e-bab7-4e59-a1e5-90b0472b7a9b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:01.036089 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9a8a9d1e-bab7-4e59-a1e5-90b0472b7a9b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:01.037013 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9a8a9d1e-bab7-4e59-a1e5-90b0472b7a9b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:01.037568 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9a8a9d1e-bab7-4e59-a1e5-90b0472b7a9b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:01.038208 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9a8a9d1e-bab7-4e59-a1e5-90b0472b7a9b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:01.216673 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-80ec81b9-82cd-48af-8050-3e34ac269558 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:01.217616 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-80ec81b9-82cd-48af-8050-3e34ac269558 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:01.224650 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-80ec81b9-82cd-48af-8050-3e34ac269558 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:01.225134 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-80ec81b9-82cd-48af-8050-3e34ac269558 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:01.225770 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-80ec81b9-82cd-48af-8050-3e34ac269558 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:01.226747 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-80ec81b9-82cd-48af-8050-3e34ac269558 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:01.227215 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-80ec81b9-82cd-48af-8050-3e34ac269558 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:01.227819 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-80ec81b9-82cd-48af-8050-3e34ac269558 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:01.451660 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-80ec81b9-82cd-48af-8050-3e34ac269558 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:01.463718 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-80ec81b9-82cd-48af-8050-3e34ac269558 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1522 microversion: 2.1 time: 0.251103 Oct 11 12:02:01.464805 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 116/239] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:01 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:02:01.504936 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-9a8a9d1e-bab7-4e59-a1e5-90b0472b7a9b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:01.521737 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9a8a9d1e-bab7-4e59-a1e5-90b0472b7a9b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1314 microversion: 2.1 time: 0.506323 Oct 11 12:02:01.523117 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 124/240] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:01 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1314 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:02.501715 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-a7d2685e-1631-477c-a4ac-e7d1d3b2c142 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:02.503138 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-a7d2685e-1631-477c-a4ac-e7d1d3b2c142 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:02.515083 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a7d2685e-1631-477c-a4ac-e7d1d3b2c142 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:02.516258 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a7d2685e-1631-477c-a4ac-e7d1d3b2c142 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:02.517218 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a7d2685e-1631-477c-a4ac-e7d1d3b2c142 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:02.518735 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a7d2685e-1631-477c-a4ac-e7d1d3b2c142 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:02.519749 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a7d2685e-1631-477c-a4ac-e7d1d3b2c142 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:02.520668 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a7d2685e-1631-477c-a4ac-e7d1d3b2c142 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:02.560492 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5f1188ff-e454-4d60-a01b-a2e2c8d5df3b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:02.563676 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-5f1188ff-e454-4d60-a01b-a2e2c8d5df3b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:02.583869 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5f1188ff-e454-4d60-a01b-a2e2c8d5df3b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:02.585579 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5f1188ff-e454-4d60-a01b-a2e2c8d5df3b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:02.587776 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5f1188ff-e454-4d60-a01b-a2e2c8d5df3b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:02.589776 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5f1188ff-e454-4d60-a01b-a2e2c8d5df3b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:02.591420 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5f1188ff-e454-4d60-a01b-a2e2c8d5df3b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:02.592521 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5f1188ff-e454-4d60-a01b-a2e2c8d5df3b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:02.779583 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-a7d2685e-1631-477c-a4ac-e7d1d3b2c142 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:02.789235 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-a7d2685e-1631-477c-a4ac-e7d1d3b2c142 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1522 microversion: 2.1 time: 0.295219 Oct 11 12:02:02.809183 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 117/241] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:02 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:03.116352 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5f1188ff-e454-4d60-a01b-a2e2c8d5df3b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:03.133853 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5f1188ff-e454-4d60-a01b-a2e2c8d5df3b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1314 microversion: 2.1 time: 0.583020 Oct 11 12:02:03.134483 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 125/242] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:02 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1314 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:02:03.817797 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-38c6413e-e0ef-4fa1-b270-59d6e4513740 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:03.818747 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-38c6413e-e0ef-4fa1-b270-59d6e4513740 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:03.825584 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:02:03.829837 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-38c6413e-e0ef-4fa1-b270-59d6e4513740 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:03.832534 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-38c6413e-e0ef-4fa1-b270-59d6e4513740 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:03.833380 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-38c6413e-e0ef-4fa1-b270-59d6e4513740 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:03.834344 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-38c6413e-e0ef-4fa1-b270-59d6e4513740 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:03.835024 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-38c6413e-e0ef-4fa1-b270-59d6e4513740 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:03.835623 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-38c6413e-e0ef-4fa1-b270-59d6e4513740 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:04.049714 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-38c6413e-e0ef-4fa1-b270-59d6e4513740 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:04.068569 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-38c6413e-e0ef-4fa1-b270-59d6e4513740 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1522 microversion: 2.1 time: 0.254832 Oct 11 12:02:04.070397 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 118/243] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:03 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:02:04.172256 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3c214a83-64b9-41c2-ad6c-311c70dec064 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:04.176476 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-3c214a83-64b9-41c2-ad6c-311c70dec064 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:04.190240 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3c214a83-64b9-41c2-ad6c-311c70dec064 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:04.194095 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3c214a83-64b9-41c2-ad6c-311c70dec064 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:04.194879 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3c214a83-64b9-41c2-ad6c-311c70dec064 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:04.195947 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3c214a83-64b9-41c2-ad6c-311c70dec064 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:04.196574 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3c214a83-64b9-41c2-ad6c-311c70dec064 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:04.197147 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3c214a83-64b9-41c2-ad6c-311c70dec064 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:04.497577 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-3c214a83-64b9-41c2-ad6c-311c70dec064 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:04.512837 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-3c214a83-64b9-41c2-ad6c-311c70dec064 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1314 microversion: 2.1 time: 0.347412 Oct 11 12:02:04.513919 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 126/244] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:04 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:05.100188 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-70ff4d73-4a15-4db8-b930-5849ba940681 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:05.103038 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-70ff4d73-4a15-4db8-b930-5849ba940681 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:05.114524 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-70ff4d73-4a15-4db8-b930-5849ba940681 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:05.115390 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-70ff4d73-4a15-4db8-b930-5849ba940681 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:05.117480 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-70ff4d73-4a15-4db8-b930-5849ba940681 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:05.119308 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-70ff4d73-4a15-4db8-b930-5849ba940681 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:05.120481 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-70ff4d73-4a15-4db8-b930-5849ba940681 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:05.121288 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-70ff4d73-4a15-4db8-b930-5849ba940681 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:05.401981 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-70ff4d73-4a15-4db8-b930-5849ba940681 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:05.422833 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-70ff4d73-4a15-4db8-b930-5849ba940681 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1522 microversion: 2.1 time: 0.327136 Oct 11 12:02:05.422833 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 119/245] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:05 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:05.539818 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-d0413c88-195b-4bd6-a144-ad16437e5e10 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:05.541189 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-d0413c88-195b-4bd6-a144-ad16437e5e10 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:05.551343 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d0413c88-195b-4bd6-a144-ad16437e5e10 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:05.552076 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d0413c88-195b-4bd6-a144-ad16437e5e10 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:05.552816 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d0413c88-195b-4bd6-a144-ad16437e5e10 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:05.554093 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d0413c88-195b-4bd6-a144-ad16437e5e10 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:05.555243 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d0413c88-195b-4bd6-a144-ad16437e5e10 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:05.556135 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d0413c88-195b-4bd6-a144-ad16437e5e10 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:05.658753 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-879d7939-fd4b-4805-9fc0-c5f6eee060f0 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Action: 'create', calling method: .version_select at 0x7fd4068b7700>, body: {"keypair": {"name": "tempest-keypair-1579482174", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkX5q2hG0IfR3xEeiWmN7YNwScx30cmmM5cZFI0oSYnrf2tJWmgo9FCsUdz3Z8VFEqHhxpaDwqyTcGaozTAQwxK4R9vR7pOQJd0UkNIu8XyHtWM/8OLQraET7y1sqhulg=="}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:02:05.711739 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-879d7939-fd4b-4805-9fc0-c5f6eee060f0 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Getting quotas for project 9a7beb3a9d2b4ee9ba323d5bccc618c2. Resources: {'key_pairs'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 12:02:05.719907 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-879d7939-fd4b-4805-9fc0-c5f6eee060f0 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Getting quotas for user a78e40d4eb554ca49eeec530a7adf428 and project 9a7beb3a9d2b4ee9ba323d5bccc618c2. Resources: {'key_pairs'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 12:02:05.763969 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-d0413c88-195b-4bd6-a144-ad16437e5e10 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:05.777315 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-879d7939-fd4b-4805-9fc0-c5f6eee060f0 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.293461 Oct 11 12:02:05.779123 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 127/246] 10.222.0.59 () {60 vars in 1159 bytes} [Tue Oct 11 12:02:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:02:05.780674 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-d0413c88-195b-4bd6-a144-ad16437e5e10 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1314 microversion: 2.1 time: 0.247067 Oct 11 12:02:05.781780 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 120/247] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:05 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:06.457063 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ed0e2eda-4a55-4821-a024-3cf48d61ed43 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:06.458356 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ed0e2eda-4a55-4821-a024-3cf48d61ed43 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:06.479714 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ed0e2eda-4a55-4821-a024-3cf48d61ed43 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:06.496976 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ed0e2eda-4a55-4821-a024-3cf48d61ed43 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:06.497442 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ed0e2eda-4a55-4821-a024-3cf48d61ed43 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:06.498414 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ed0e2eda-4a55-4821-a024-3cf48d61ed43 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:06.504693 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ed0e2eda-4a55-4821-a024-3cf48d61ed43 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:06.505863 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ed0e2eda-4a55-4821-a024-3cf48d61ed43 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:06.761770 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ed0e2eda-4a55-4821-a024-3cf48d61ed43 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:06.777528 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ed0e2eda-4a55-4821-a024-3cf48d61ed43 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1522 microversion: 2.1 time: 0.335549 Oct 11 12:02:06.799206 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 128/248] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:06 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1522 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:06.810691 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-77260bc7-5565-4b83-9fac-ffd21e7d6e2c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:06.813373 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-77260bc7-5565-4b83-9fac-ffd21e7d6e2c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:06.825363 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-77260bc7-5565-4b83-9fac-ffd21e7d6e2c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:06.825972 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-77260bc7-5565-4b83-9fac-ffd21e7d6e2c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:06.826517 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-77260bc7-5565-4b83-9fac-ffd21e7d6e2c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:06.827650 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-77260bc7-5565-4b83-9fac-ffd21e7d6e2c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:06.828266 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-77260bc7-5565-4b83-9fac-ffd21e7d6e2c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:06.828834 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-77260bc7-5565-4b83-9fac-ffd21e7d6e2c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:07.053076 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-77260bc7-5565-4b83-9fac-ffd21e7d6e2c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:07.077040 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-77260bc7-5565-4b83-9fac-ffd21e7d6e2c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1314 microversion: 2.1 time: 0.275521 Oct 11 12:02:07.078054 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 121/249] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:06 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1314 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:07.272008 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-0793e292-5171-437e-a84c-a80eaec2f4e0 req-0b8c8657-8859-41d9-8c4b-7e98376a0c6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f4546a4-8930-4f69-8f88-e4b23dc9d21c", "name": "network-vif-plugged", "status": "completed", "tag": "09a5433d-8875-4b65-bf36-ec574c211097"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:02:07.292787 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-0793e292-5171-437e-a84c-a80eaec2f4e0 req-0b8c8657-8859-41d9-8c4b-7e98376a0c6a service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:07.295170 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-0793e292-5171-437e-a84c-a80eaec2f4e0 req-0b8c8657-8859-41d9-8c4b-7e98376a0c6a service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:07.296312 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-0793e292-5171-437e-a84c-a80eaec2f4e0 req-0b8c8657-8859-41d9-8c4b-7e98376a0c6a service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:07.321543 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-0793e292-5171-437e-a84c-a80eaec2f4e0 req-0b8c8657-8859-41d9-8c4b-7e98376a0c6a service nova] Creating event network-vif-plugged:09a5433d-8875-4b65-bf36-ec574c211097 for instance 4f4546a4-8930-4f69-8f88-e4b23dc9d21c on hv-cinder-82099 Oct 11 12:02:07.331505 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-0793e292-5171-437e-a84c-a80eaec2f4e0 req-0b8c8657-8859-41d9-8c4b-7e98376a0c6a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067388 Oct 11 12:02:07.332829 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 129/250] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:02:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 12:02:07.815780 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-b25b47ad-e53b-4544-a5a4-55b22ce8c25a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:07.818242 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-b25b47ad-e53b-4544-a5a4-55b22ce8c25a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:07.836278 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b25b47ad-e53b-4544-a5a4-55b22ce8c25a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:07.839350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b25b47ad-e53b-4544-a5a4-55b22ce8c25a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:07.841014 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b25b47ad-e53b-4544-a5a4-55b22ce8c25a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:07.842549 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b25b47ad-e53b-4544-a5a4-55b22ce8c25a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:07.843723 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b25b47ad-e53b-4544-a5a4-55b22ce8c25a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:07.844739 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b25b47ad-e53b-4544-a5a4-55b22ce8c25a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:08.104108 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0a0ed246-841f-44fb-90ea-c3f179e5df07 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:08.106085 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0a0ed246-841f-44fb-90ea-c3f179e5df07 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:08.116012 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-b25b47ad-e53b-4544-a5a4-55b22ce8c25a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:08.138960 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0a0ed246-841f-44fb-90ea-c3f179e5df07 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:08.143552 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-b25b47ad-e53b-4544-a5a4-55b22ce8c25a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1522 microversion: 2.1 time: 0.335438 Oct 11 12:02:08.145445 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 122/251] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:07 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1522 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:08.146805 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0a0ed246-841f-44fb-90ea-c3f179e5df07 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:08.147869 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0a0ed246-841f-44fb-90ea-c3f179e5df07 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:08.161531 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0a0ed246-841f-44fb-90ea-c3f179e5df07 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:08.168250 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0a0ed246-841f-44fb-90ea-c3f179e5df07 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:08.170843 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0a0ed246-841f-44fb-90ea-c3f179e5df07 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:08.558950 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0a0ed246-841f-44fb-90ea-c3f179e5df07 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:08.570097 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-c49e9b2c-cb1e-4bbd-86d7-e2b8339b7069 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-909449964", "imageRef": "09bcc8f8-a32f-4ec8-9ab2-a98964ad6a01", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae19ec92-ec5c-4f84-8d72-b606de6137b2"}], "security_groups": [{"name": "tempest-securitygroup--1312550115"}], "key_name": "tempest-keypair-1579482174", "user_data": "}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:02:08.577043 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0a0ed246-841f-44fb-90ea-c3f179e5df07 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1314 microversion: 2.1 time: 0.479574 Oct 11 12:02:08.578484 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 130/252] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:08 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:02:08.754738 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.network.neutron [None req-c49e9b2c-cb1e-4bbd-86d7-e2b8339b7069 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] validate_networks() for [('ae19ec92-ec5c-4f84-8d72-b606de6137b2', None, None, None, None, None)] {{(pid=118994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 12:02:09.189160 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-02649a2e-483e-4a6f-aef0-25b6a0ef122b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:09.190245 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-02649a2e-483e-4a6f-aef0-25b6a0ef122b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:09.194204 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:02:09.204787 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-02649a2e-483e-4a6f-aef0-25b6a0ef122b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:09.205697 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-02649a2e-483e-4a6f-aef0-25b6a0ef122b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:09.206534 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-02649a2e-483e-4a6f-aef0-25b6a0ef122b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:09.207907 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-02649a2e-483e-4a6f-aef0-25b6a0ef122b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:09.208744 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-02649a2e-483e-4a6f-aef0-25b6a0ef122b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:09.209807 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-02649a2e-483e-4a6f-aef0-25b6a0ef122b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:09.322620 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-c49e9b2c-cb1e-4bbd-86d7-e2b8339b7069 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Flavor limits 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 12:02:09.323722 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-c49e9b2c-cb1e-4bbd-86d7-e2b8339b7069 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Image limits 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 12:02:09.324548 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-c49e9b2c-cb1e-4bbd-86d7-e2b8339b7069 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Flavor pref 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 12:02:09.324976 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-c49e9b2c-cb1e-4bbd-86d7-e2b8339b7069 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Image pref 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 12:02:09.325542 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-c49e9b2c-cb1e-4bbd-86d7-e2b8339b7069 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 12:02:09.338544 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c49e9b2c-cb1e-4bbd-86d7-e2b8339b7069 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:09.339437 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c49e9b2c-cb1e-4bbd-86d7-e2b8339b7069 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:09.340255 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c49e9b2c-cb1e-4bbd-86d7-e2b8339b7069 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:09.341889 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c49e9b2c-cb1e-4bbd-86d7-e2b8339b7069 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:09.342800 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c49e9b2c-cb1e-4bbd-86d7-e2b8339b7069 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:09.343447 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c49e9b2c-cb1e-4bbd-86d7-e2b8339b7069 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:09.356773 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:02:09.384704 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-c49e9b2c-cb1e-4bbd-86d7-e2b8339b7069 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Getting quotas for project 9a7beb3a9d2b4ee9ba323d5bccc618c2. Resources: {'ram', 'instances', 'cores'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 12:02:09.396697 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-c49e9b2c-cb1e-4bbd-86d7-e2b8339b7069 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Getting quotas for user a78e40d4eb554ca49eeec530a7adf428 and project 9a7beb3a9d2b4ee9ba323d5bccc618c2. Resources: {'ram', 'instances', 'cores'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 12:02:09.413837 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-c49e9b2c-cb1e-4bbd-86d7-e2b8339b7069 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Going to run 1 instances... {{(pid=118994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 12:02:09.416799 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-c49e9b2c-cb1e-4bbd-86d7-e2b8339b7069 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09bcc8f8-a32f-4ec8-9ab2-a98964ad6a01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 12:02:09.453808 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-02649a2e-483e-4a6f-aef0-25b6a0ef122b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:09.468145 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-02649a2e-483e-4a6f-aef0-25b6a0ef122b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1522 microversion: 2.1 time: 0.286360 Oct 11 12:02:09.469148 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 131/253] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:09 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1522 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:02:09.488818 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-c49e9b2c-cb1e-4bbd-86d7-e2b8339b7069 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.926729 Oct 11 12:02:09.489755 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 123/254] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Oct 11 12:02:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 12:02:09.510259 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-06b93f37-b159-4716-9f47-b6c4f0554299 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:09.511379 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-06b93f37-b159-4716-9f47-b6c4f0554299 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:09.598853 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-06b93f37-b159-4716-9f47-b6c4f0554299 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:09.615614 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-bf1ce319-3933-4ef0-9c7f-39d97e856159 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:09.616109 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-06b93f37-b159-4716-9f47-b6c4f0554299 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1237 microversion: 2.1 time: 0.113441 Oct 11 12:02:09.617407 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-bf1ce319-3933-4ef0-9c7f-39d97e856159 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:09.619517 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 132/255] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:09 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1237 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:02:09.630465 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bf1ce319-3933-4ef0-9c7f-39d97e856159 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:09.632354 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bf1ce319-3933-4ef0-9c7f-39d97e856159 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:09.633952 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bf1ce319-3933-4ef0-9c7f-39d97e856159 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:09.635328 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bf1ce319-3933-4ef0-9c7f-39d97e856159 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:09.639902 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bf1ce319-3933-4ef0-9c7f-39d97e856159 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:09.641056 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bf1ce319-3933-4ef0-9c7f-39d97e856159 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:09.915796 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-bf1ce319-3933-4ef0-9c7f-39d97e856159 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:09.935679 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-bf1ce319-3933-4ef0-9c7f-39d97e856159 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1314 microversion: 2.1 time: 0.327541 Oct 11 12:02:09.938633 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 124/256] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:09 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:10.507383 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-bd51da58-15a8-4463-bcda-9e109c09c5da tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:10.508240 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-bd51da58-15a8-4463-bcda-9e109c09c5da tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:10.515498 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd51da58-15a8-4463-bcda-9e109c09c5da tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:10.515909 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd51da58-15a8-4463-bcda-9e109c09c5da tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:10.516340 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd51da58-15a8-4463-bcda-9e109c09c5da tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:10.517061 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd51da58-15a8-4463-bcda-9e109c09c5da tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:10.517505 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd51da58-15a8-4463-bcda-9e109c09c5da tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:10.517923 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd51da58-15a8-4463-bcda-9e109c09c5da tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:10.645302 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-3af4c496-fae0-4c59-9bf5-733d0ee4b6ce tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:10.646074 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-3af4c496-fae0-4c59-9bf5-733d0ee4b6ce tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:10.662366 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3af4c496-fae0-4c59-9bf5-733d0ee4b6ce tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:10.663257 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3af4c496-fae0-4c59-9bf5-733d0ee4b6ce tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:10.664018 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3af4c496-fae0-4c59-9bf5-733d0ee4b6ce tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:10.665080 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3af4c496-fae0-4c59-9bf5-733d0ee4b6ce tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:10.665683 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3af4c496-fae0-4c59-9bf5-733d0ee4b6ce tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:10.666227 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3af4c496-fae0-4c59-9bf5-733d0ee4b6ce tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:10.723416 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-bd51da58-15a8-4463-bcda-9e109c09c5da tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:10.732558 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-bd51da58-15a8-4463-bcda-9e109c09c5da tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1522 microversion: 2.1 time: 0.229047 Oct 11 12:02:10.746771 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 133/257] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:10 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:10.757737 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-3af4c496-fae0-4c59-9bf5-733d0ee4b6ce tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:10.771196 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-3af4c496-fae0-4c59-9bf5-733d0ee4b6ce tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1241 microversion: 2.1 time: 0.132513 Oct 11 12:02:10.772342 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 125/258] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:10 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1241 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:10.980757 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9be93702-fd51-4945-a5c4-e29d580f7382 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:10.981565 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9be93702-fd51-4945-a5c4-e29d580f7382 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:10.990801 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9be93702-fd51-4945-a5c4-e29d580f7382 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:10.991527 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9be93702-fd51-4945-a5c4-e29d580f7382 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:10.992143 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9be93702-fd51-4945-a5c4-e29d580f7382 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:10.993199 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9be93702-fd51-4945-a5c4-e29d580f7382 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:10.993802 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9be93702-fd51-4945-a5c4-e29d580f7382 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:10.994388 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9be93702-fd51-4945-a5c4-e29d580f7382 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:11.152408 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-9be93702-fd51-4945-a5c4-e29d580f7382 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:11.161105 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9be93702-fd51-4945-a5c4-e29d580f7382 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1314 microversion: 2.1 time: 0.187417 Oct 11 12:02:11.161714 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 134/259] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:10 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:11.757115 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-78e3c89c-ddf7-42d0-a5b6-f7cb6b5f39c7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:11.757719 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-78e3c89c-ddf7-42d0-a5b6-f7cb6b5f39c7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:11.764936 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-78e3c89c-ddf7-42d0-a5b6-f7cb6b5f39c7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:11.765559 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-78e3c89c-ddf7-42d0-a5b6-f7cb6b5f39c7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:11.766007 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-78e3c89c-ddf7-42d0-a5b6-f7cb6b5f39c7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:11.766800 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-78e3c89c-ddf7-42d0-a5b6-f7cb6b5f39c7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:11.767341 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-78e3c89c-ddf7-42d0-a5b6-f7cb6b5f39c7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:11.767765 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-78e3c89c-ddf7-42d0-a5b6-f7cb6b5f39c7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:11.806879 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-cbea8ccf-c21e-41bd-91c0-76c3ac631bd7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:11.807980 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-cbea8ccf-c21e-41bd-91c0-76c3ac631bd7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:11.817580 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cbea8ccf-c21e-41bd-91c0-76c3ac631bd7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:11.818367 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cbea8ccf-c21e-41bd-91c0-76c3ac631bd7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:11.819184 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cbea8ccf-c21e-41bd-91c0-76c3ac631bd7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:11.820103 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cbea8ccf-c21e-41bd-91c0-76c3ac631bd7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:11.820720 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cbea8ccf-c21e-41bd-91c0-76c3ac631bd7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:11.821283 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cbea8ccf-c21e-41bd-91c0-76c3ac631bd7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:11.909473 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-cbea8ccf-c21e-41bd-91c0-76c3ac631bd7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:11.922664 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-cbea8ccf-c21e-41bd-91c0-76c3ac631bd7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1241 microversion: 2.1 time: 0.120727 Oct 11 12:02:11.923487 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 135/260] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:11 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1241 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:02:11.940928 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-78e3c89c-ddf7-42d0-a5b6-f7cb6b5f39c7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:11.956227 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-78e3c89c-ddf7-42d0-a5b6-f7cb6b5f39c7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1522 microversion: 2.1 time: 0.203026 Oct 11 12:02:11.957019 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 126/261] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:11 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:12.189696 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6cf22c43-e562-4e2f-b525-077aa27bd9bc tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:12.190681 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-6cf22c43-e562-4e2f-b525-077aa27bd9bc tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:12.202417 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6cf22c43-e562-4e2f-b525-077aa27bd9bc tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:12.204783 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6cf22c43-e562-4e2f-b525-077aa27bd9bc tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:12.206008 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6cf22c43-e562-4e2f-b525-077aa27bd9bc tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:12.208288 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6cf22c43-e562-4e2f-b525-077aa27bd9bc tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:12.209531 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6cf22c43-e562-4e2f-b525-077aa27bd9bc tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:12.210342 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6cf22c43-e562-4e2f-b525-077aa27bd9bc tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:12.219097 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=100 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:02:12.393830 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6cf22c43-e562-4e2f-b525-077aa27bd9bc tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:12.404066 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6cf22c43-e562-4e2f-b525-077aa27bd9bc tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1314 microversion: 2.1 time: 0.222038 Oct 11 12:02:12.404863 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 136/262] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:12 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:12.957630 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-377c4ae4-17e6-42bb-8c60-7ea411cd8d2a tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:12.958782 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-377c4ae4-17e6-42bb-8c60-7ea411cd8d2a tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:12.965680 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-377c4ae4-17e6-42bb-8c60-7ea411cd8d2a tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:12.966176 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-377c4ae4-17e6-42bb-8c60-7ea411cd8d2a tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:12.966599 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-377c4ae4-17e6-42bb-8c60-7ea411cd8d2a tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:12.967313 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-377c4ae4-17e6-42bb-8c60-7ea411cd8d2a tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:12.967755 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-377c4ae4-17e6-42bb-8c60-7ea411cd8d2a tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:12.968583 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-377c4ae4-17e6-42bb-8c60-7ea411cd8d2a tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:12.996678 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e973aea0-7c95-490b-a6b2-6db3528c7289 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:12.998487 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e973aea0-7c95-490b-a6b2-6db3528c7289 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:13.009472 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e973aea0-7c95-490b-a6b2-6db3528c7289 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:13.010319 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e973aea0-7c95-490b-a6b2-6db3528c7289 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:13.011095 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e973aea0-7c95-490b-a6b2-6db3528c7289 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:13.012346 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e973aea0-7c95-490b-a6b2-6db3528c7289 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:13.013110 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e973aea0-7c95-490b-a6b2-6db3528c7289 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:13.013839 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e973aea0-7c95-490b-a6b2-6db3528c7289 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:13.067563 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-377c4ae4-17e6-42bb-8c60-7ea411cd8d2a tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:13.077434 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-377c4ae4-17e6-42bb-8c60-7ea411cd8d2a tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1233 microversion: 2.1 time: 0.123597 Oct 11 12:02:13.078264 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 127/263] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:12 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1233 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:13.211148 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e973aea0-7c95-490b-a6b2-6db3528c7289 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:13.225412 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e973aea0-7c95-490b-a6b2-6db3528c7289 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1522 microversion: 2.1 time: 0.233630 Oct 11 12:02:13.226459 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 137/264] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:12 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:13.433875 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-51b67373-62fd-414b-9ad5-c70d7be9d9d8 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:13.434704 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-51b67373-62fd-414b-9ad5-c70d7be9d9d8 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:13.442201 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-51b67373-62fd-414b-9ad5-c70d7be9d9d8 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:13.442799 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-51b67373-62fd-414b-9ad5-c70d7be9d9d8 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:13.443239 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-51b67373-62fd-414b-9ad5-c70d7be9d9d8 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:13.444015 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-51b67373-62fd-414b-9ad5-c70d7be9d9d8 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:13.444491 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-51b67373-62fd-414b-9ad5-c70d7be9d9d8 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:13.445061 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-51b67373-62fd-414b-9ad5-c70d7be9d9d8 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:13.621552 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-51b67373-62fd-414b-9ad5-c70d7be9d9d8 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:13.635924 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-51b67373-62fd-414b-9ad5-c70d7be9d9d8 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1314 microversion: 2.1 time: 0.206329 Oct 11 12:02:13.637000 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 128/265] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:13 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:02:14.114052 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-479bcbf9-5ad5-450e-a74e-13168d5473ae tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:14.114714 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-479bcbf9-5ad5-450e-a74e-13168d5473ae tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:14.122447 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-479bcbf9-5ad5-450e-a74e-13168d5473ae tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:14.123229 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-479bcbf9-5ad5-450e-a74e-13168d5473ae tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:14.123755 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-479bcbf9-5ad5-450e-a74e-13168d5473ae tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:14.124604 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-479bcbf9-5ad5-450e-a74e-13168d5473ae tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:14.125460 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-479bcbf9-5ad5-450e-a74e-13168d5473ae tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:14.125931 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-479bcbf9-5ad5-450e-a74e-13168d5473ae tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:14.224277 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-479bcbf9-5ad5-450e-a74e-13168d5473ae tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:14.233011 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-479bcbf9-5ad5-450e-a74e-13168d5473ae tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1289 microversion: 2.1 time: 0.124620 Oct 11 12:02:14.233619 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 138/266] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:14 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1289 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:02:14.257256 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-d7b15eb7-128c-481f-9878-41dcdd31825a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:14.258263 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-d7b15eb7-128c-481f-9878-41dcdd31825a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:14.266491 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d7b15eb7-128c-481f-9878-41dcdd31825a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:14.267256 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d7b15eb7-128c-481f-9878-41dcdd31825a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:14.267737 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d7b15eb7-128c-481f-9878-41dcdd31825a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:14.268484 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d7b15eb7-128c-481f-9878-41dcdd31825a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:14.269002 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d7b15eb7-128c-481f-9878-41dcdd31825a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:14.269469 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d7b15eb7-128c-481f-9878-41dcdd31825a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:14.458069 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-d7b15eb7-128c-481f-9878-41dcdd31825a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:14.468771 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-d7b15eb7-128c-481f-9878-41dcdd31825a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1522 microversion: 2.1 time: 0.215794 Oct 11 12:02:14.469428 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 129/267] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:14 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:14.678999 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-27b7f1d3-c924-4e0b-b147-802c2d9a4718 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:14.679921 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-27b7f1d3-c924-4e0b-b147-802c2d9a4718 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:14.695038 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-27b7f1d3-c924-4e0b-b147-802c2d9a4718 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:14.696592 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-27b7f1d3-c924-4e0b-b147-802c2d9a4718 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:14.697455 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-27b7f1d3-c924-4e0b-b147-802c2d9a4718 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:14.698871 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-27b7f1d3-c924-4e0b-b147-802c2d9a4718 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:14.699897 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-27b7f1d3-c924-4e0b-b147-802c2d9a4718 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:14.701790 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-27b7f1d3-c924-4e0b-b147-802c2d9a4718 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:14.943260 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-27b7f1d3-c924-4e0b-b147-802c2d9a4718 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:14.951487 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-27b7f1d3-c924-4e0b-b147-802c2d9a4718 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1497 microversion: 2.1 time: 0.281228 Oct 11 12:02:14.952151 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 139/268] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:14 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1497 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:15.264963 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-e02814e9-cd0d-4a59-b0ad-7a8660738f61 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:15.266594 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-e02814e9-cd0d-4a59-b0ad-7a8660738f61 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:15.280876 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e02814e9-cd0d-4a59-b0ad-7a8660738f61 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:15.281726 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e02814e9-cd0d-4a59-b0ad-7a8660738f61 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:15.282723 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e02814e9-cd0d-4a59-b0ad-7a8660738f61 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:15.283947 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e02814e9-cd0d-4a59-b0ad-7a8660738f61 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:15.285295 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e02814e9-cd0d-4a59-b0ad-7a8660738f61 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:15.286387 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e02814e9-cd0d-4a59-b0ad-7a8660738f61 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:15.408340 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-e02814e9-cd0d-4a59-b0ad-7a8660738f61 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:15.429433 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-e02814e9-cd0d-4a59-b0ad-7a8660738f61 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1307 microversion: 2.1 time: 0.173596 Oct 11 12:02:15.431393 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 130/269] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:15 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1307 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:15.503203 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d76b3fa0-b530-4bc3-8fe9-5c0ea77a74d7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:15.505703 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d76b3fa0-b530-4bc3-8fe9-5c0ea77a74d7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:15.520913 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d76b3fa0-b530-4bc3-8fe9-5c0ea77a74d7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:15.521769 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d76b3fa0-b530-4bc3-8fe9-5c0ea77a74d7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:15.522796 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d76b3fa0-b530-4bc3-8fe9-5c0ea77a74d7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:15.524340 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d76b3fa0-b530-4bc3-8fe9-5c0ea77a74d7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:15.525124 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d76b3fa0-b530-4bc3-8fe9-5c0ea77a74d7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:15.526692 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d76b3fa0-b530-4bc3-8fe9-5c0ea77a74d7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:15.776935 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d76b3fa0-b530-4bc3-8fe9-5c0ea77a74d7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:15.792364 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d76b3fa0-b530-4bc3-8fe9-5c0ea77a74d7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1522 microversion: 2.1 time: 0.300286 Oct 11 12:02:15.793698 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 140/270] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:15 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:16.040287 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-2d039a79-6b1d-4e9b-888f-2678dee75973 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:16.041163 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-2d039a79-6b1d-4e9b-888f-2678dee75973 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:16.055536 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2d039a79-6b1d-4e9b-888f-2678dee75973 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:16.056886 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2d039a79-6b1d-4e9b-888f-2678dee75973 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:16.057006 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2d039a79-6b1d-4e9b-888f-2678dee75973 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:16.058377 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2d039a79-6b1d-4e9b-888f-2678dee75973 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:16.059352 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2d039a79-6b1d-4e9b-888f-2678dee75973 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:16.059924 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2d039a79-6b1d-4e9b-888f-2678dee75973 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:16.107257 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-2d039a79-6b1d-4e9b-888f-2678dee75973 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Going to try to terminate instance {{(pid=118994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 12:02:16.273087 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-2d039a79-6b1d-4e9b-888f-2678dee75973 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 204 len: 0 microversion: 2.1 time: 0.240033 Oct 11 12:02:16.274778 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 131/271] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Oct 11 12:02:16 2022] DELETE /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 0 bytes in 243 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 12:02:16.289081 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-4632af98-4270-4f72-a7c5-742cdff95df7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:16.319603 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-4632af98-4270-4f72-a7c5-742cdff95df7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:16.326869 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4632af98-4270-4f72-a7c5-742cdff95df7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:16.327363 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4632af98-4270-4f72-a7c5-742cdff95df7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:16.328015 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4632af98-4270-4f72-a7c5-742cdff95df7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:16.328905 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4632af98-4270-4f72-a7c5-742cdff95df7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:16.329362 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4632af98-4270-4f72-a7c5-742cdff95df7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:16.330885 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4632af98-4270-4f72-a7c5-742cdff95df7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:16.473988 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-2f7b2b9f-15f5-486f-bd6c-b3f70df2b651 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:16.475353 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-2f7b2b9f-15f5-486f-bd6c-b3f70df2b651 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:16.483894 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2f7b2b9f-15f5-486f-bd6c-b3f70df2b651 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:16.484528 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2f7b2b9f-15f5-486f-bd6c-b3f70df2b651 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:16.485084 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2f7b2b9f-15f5-486f-bd6c-b3f70df2b651 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:16.486016 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2f7b2b9f-15f5-486f-bd6c-b3f70df2b651 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:16.486798 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2f7b2b9f-15f5-486f-bd6c-b3f70df2b651 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:16.487835 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2f7b2b9f-15f5-486f-bd6c-b3f70df2b651 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:16.537358 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-4632af98-4270-4f72-a7c5-742cdff95df7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:16.557330 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-4632af98-4270-4f72-a7c5-742cdff95df7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1503 microversion: 2.1 time: 0.277099 Oct 11 12:02:16.558038 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 141/272] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:16 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1503 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:16.686389 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-2f7b2b9f-15f5-486f-bd6c-b3f70df2b651 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:16.694796 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-2f7b2b9f-15f5-486f-bd6c-b3f70df2b651 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1363 microversion: 2.1 time: 0.227889 Oct 11 12:02:16.695394 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 132/273] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:16 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:16.834654 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-bd69aa33-c9b3-44e5-9575-66b30b6063c9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:16.835480 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-bd69aa33-c9b3-44e5-9575-66b30b6063c9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:16.842871 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd69aa33-c9b3-44e5-9575-66b30b6063c9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:16.843865 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd69aa33-c9b3-44e5-9575-66b30b6063c9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:16.845093 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd69aa33-c9b3-44e5-9575-66b30b6063c9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:16.845845 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd69aa33-c9b3-44e5-9575-66b30b6063c9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:16.846291 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd69aa33-c9b3-44e5-9575-66b30b6063c9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:16.846743 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd69aa33-c9b3-44e5-9575-66b30b6063c9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:17.033538 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-bd69aa33-c9b3-44e5-9575-66b30b6063c9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:17.047526 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-bd69aa33-c9b3-44e5-9575-66b30b6063c9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1522 microversion: 2.1 time: 0.217145 Oct 11 12:02:17.048503 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 142/274] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:16 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:17.585065 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-c15c5899-d855-4969-b4de-922ba3f8168b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:17.586224 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-c15c5899-d855-4969-b4de-922ba3f8168b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:17.595854 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c15c5899-d855-4969-b4de-922ba3f8168b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:17.596575 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c15c5899-d855-4969-b4de-922ba3f8168b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:17.597307 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c15c5899-d855-4969-b4de-922ba3f8168b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:17.598199 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c15c5899-d855-4969-b4de-922ba3f8168b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:17.598870 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c15c5899-d855-4969-b4de-922ba3f8168b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:17.599568 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c15c5899-d855-4969-b4de-922ba3f8168b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:17.717227 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-af69b963-2238-4563-b1b6-448d2f2b6e95 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:17.718079 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-af69b963-2238-4563-b1b6-448d2f2b6e95 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:17.726427 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-af69b963-2238-4563-b1b6-448d2f2b6e95 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:17.727072 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-af69b963-2238-4563-b1b6-448d2f2b6e95 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:17.727510 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-af69b963-2238-4563-b1b6-448d2f2b6e95 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:17.728235 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-af69b963-2238-4563-b1b6-448d2f2b6e95 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:17.728679 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-af69b963-2238-4563-b1b6-448d2f2b6e95 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:17.729278 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-af69b963-2238-4563-b1b6-448d2f2b6e95 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:17.780848 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-c15c5899-d855-4969-b4de-922ba3f8168b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:17.805422 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-c15c5899-d855-4969-b4de-922ba3f8168b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1503 microversion: 2.1 time: 0.225874 Oct 11 12:02:17.808516 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 133/275] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:17 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1503 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:17.945656 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-af69b963-2238-4563-b1b6-448d2f2b6e95 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:17.975612 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-af69b963-2238-4563-b1b6-448d2f2b6e95 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1363 microversion: 2.1 time: 0.261752 Oct 11 12:02:17.987606 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 143/276] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:17 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1363 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:02:18.078143 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-1a5c2141-5556-44cb-9ae5-433adb02196f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:18.079318 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-1a5c2141-5556-44cb-9ae5-433adb02196f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:18.090401 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1a5c2141-5556-44cb-9ae5-433adb02196f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:18.091603 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1a5c2141-5556-44cb-9ae5-433adb02196f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:18.092632 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1a5c2141-5556-44cb-9ae5-433adb02196f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:18.094173 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1a5c2141-5556-44cb-9ae5-433adb02196f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:18.095432 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1a5c2141-5556-44cb-9ae5-433adb02196f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:18.096397 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1a5c2141-5556-44cb-9ae5-433adb02196f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:18.364646 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-1a5c2141-5556-44cb-9ae5-433adb02196f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:18.381103 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-1a5c2141-5556-44cb-9ae5-433adb02196f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1522 microversion: 2.1 time: 0.309695 Oct 11 12:02:18.408551 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 134/277] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:18 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1522 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:18.834256 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-482a2a9f-942b-4c24-bb94-834bd2b18347 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:18.835358 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-482a2a9f-942b-4c24-bb94-834bd2b18347 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:18.847441 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-482a2a9f-942b-4c24-bb94-834bd2b18347 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:18.848398 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-482a2a9f-942b-4c24-bb94-834bd2b18347 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:18.849282 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-482a2a9f-942b-4c24-bb94-834bd2b18347 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:18.850297 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-482a2a9f-942b-4c24-bb94-834bd2b18347 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:18.851227 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-482a2a9f-942b-4c24-bb94-834bd2b18347 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:18.851803 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-482a2a9f-942b-4c24-bb94-834bd2b18347 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:18.886234 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-8e1c3e2c-e5ec-47e7-8d8b-e83d313202a2 req-5fb895fd-8746-425a-8d29-928c093cea4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3277e26-d502-49fd-ba21-b427effd9d91", "tag": "8addee64-ef1f-4a6a-8f09-b378e453cff5"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:02:18.908035 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-8e1c3e2c-e5ec-47e7-8d8b-e83d313202a2 req-5fb895fd-8746-425a-8d29-928c093cea4a service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:18.908742 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-8e1c3e2c-e5ec-47e7-8d8b-e83d313202a2 req-5fb895fd-8746-425a-8d29-928c093cea4a service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:18.909382 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-8e1c3e2c-e5ec-47e7-8d8b-e83d313202a2 req-5fb895fd-8746-425a-8d29-928c093cea4a service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:18.926031 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-8e1c3e2c-e5ec-47e7-8d8b-e83d313202a2 req-5fb895fd-8746-425a-8d29-928c093cea4a service nova] Creating event network-changed:8addee64-ef1f-4a6a-8f09-b378e453cff5 for instance e3277e26-d502-49fd-ba21-b427effd9d91 on hv-cinder-82099 Oct 11 12:02:18.935620 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-8e1c3e2c-e5ec-47e7-8d8b-e83d313202a2 req-5fb895fd-8746-425a-8d29-928c093cea4a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055434 Oct 11 12:02:18.937217 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 135/278] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:02:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 12:02:19.021547 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-58610480-64ce-4e86-8c19-595288ab624c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:19.022881 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-58610480-64ce-4e86-8c19-595288ab624c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:19.039662 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-58610480-64ce-4e86-8c19-595288ab624c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:19.040483 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-58610480-64ce-4e86-8c19-595288ab624c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:19.041257 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-58610480-64ce-4e86-8c19-595288ab624c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:19.042707 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-58610480-64ce-4e86-8c19-595288ab624c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:19.043390 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-58610480-64ce-4e86-8c19-595288ab624c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:19.044134 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-58610480-64ce-4e86-8c19-595288ab624c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:19.288613 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-58610480-64ce-4e86-8c19-595288ab624c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:19.297997 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-58610480-64ce-4e86-8c19-595288ab624c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1363 microversion: 2.1 time: 0.284444 Oct 11 12:02:19.298753 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 136/279] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:19 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1363 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:02:19.441222 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-1da158f9-d1fc-4f73-be90-21a837634c8b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:19.442462 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-1da158f9-d1fc-4f73-be90-21a837634c8b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:19.446069 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell0:SELECT=2 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:02:19.447365 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell0:SELECT=6 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:02:19.455280 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-482a2a9f-942b-4c24-bb94-834bd2b18347 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:19.458321 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1da158f9-d1fc-4f73-be90-21a837634c8b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:19.459219 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1da158f9-d1fc-4f73-be90-21a837634c8b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:19.459966 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1da158f9-d1fc-4f73-be90-21a837634c8b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:19.461370 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1da158f9-d1fc-4f73-be90-21a837634c8b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:19.462278 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1da158f9-d1fc-4f73-be90-21a837634c8b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:19.463156 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1da158f9-d1fc-4f73-be90-21a837634c8b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:19.464819 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-482a2a9f-942b-4c24-bb94-834bd2b18347 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1503 microversion: 2.1 time: 0.638179 Oct 11 12:02:19.465468 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 144/280] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:18 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1503 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:19.719060 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-1da158f9-d1fc-4f73-be90-21a837634c8b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:19.736591 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-1da158f9-d1fc-4f73-be90-21a837634c8b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1522 microversion: 2.1 time: 0.302684 Oct 11 12:02:19.738292 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 137/281] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:19 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1522 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:20.324972 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-09de6575-d238-4a92-b54e-20c53797df18 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:20.325957 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-09de6575-d238-4a92-b54e-20c53797df18 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:20.328825 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=6 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:02:20.337161 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-09de6575-d238-4a92-b54e-20c53797df18 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:20.344771 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-09de6575-d238-4a92-b54e-20c53797df18 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:20.344771 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-09de6575-d238-4a92-b54e-20c53797df18 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:20.344771 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-09de6575-d238-4a92-b54e-20c53797df18 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:20.344771 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-09de6575-d238-4a92-b54e-20c53797df18 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:20.345355 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-09de6575-d238-4a92-b54e-20c53797df18 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:20.501795 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-09de6575-d238-4a92-b54e-20c53797df18 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:20.506545 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-54e82c26-6c22-44a2-b686-c75eeeeffc8d tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:20.507629 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-54e82c26-6c22-44a2-b686-c75eeeeffc8d tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:20.518625 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-09de6575-d238-4a92-b54e-20c53797df18 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1363 microversion: 2.1 time: 0.197895 Oct 11 12:02:20.520009 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 145/282] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:20 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:02:20.521882 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-54e82c26-6c22-44a2-b686-c75eeeeffc8d tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:20.523471 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-54e82c26-6c22-44a2-b686-c75eeeeffc8d tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:20.524557 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-54e82c26-6c22-44a2-b686-c75eeeeffc8d tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:20.526404 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-54e82c26-6c22-44a2-b686-c75eeeeffc8d tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:20.527465 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-54e82c26-6c22-44a2-b686-c75eeeeffc8d tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:20.528096 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-54e82c26-6c22-44a2-b686-c75eeeeffc8d tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:20.613562 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-54e82c26-6c22-44a2-b686-c75eeeeffc8d tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:20.624724 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-54e82c26-6c22-44a2-b686-c75eeeeffc8d tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1461 microversion: 2.1 time: 0.125708 Oct 11 12:02:20.625291 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 138/283] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:20 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1461 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:02:20.769364 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a07a969c-79ba-4509-9825-46345e37343a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:20.770609 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a07a969c-79ba-4509-9825-46345e37343a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:20.781601 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a07a969c-79ba-4509-9825-46345e37343a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:20.782388 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a07a969c-79ba-4509-9825-46345e37343a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:20.783158 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a07a969c-79ba-4509-9825-46345e37343a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:20.784308 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a07a969c-79ba-4509-9825-46345e37343a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:20.784994 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a07a969c-79ba-4509-9825-46345e37343a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:20.785783 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a07a969c-79ba-4509-9825-46345e37343a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:20.978250 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-6236258e-2c0c-476d-9097-33ed21b5210c req-a36e6109-92fd-4bff-98dc-3230603cd7e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4f4546a4-8930-4f69-8f88-e4b23dc9d21c", "name": "network-vif-deleted", "tag": "09a5433d-8875-4b65-bf36-ec574c211097"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:02:20.994149 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-6236258e-2c0c-476d-9097-33ed21b5210c req-a36e6109-92fd-4bff-98dc-3230603cd7e6 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:20.994651 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-6236258e-2c0c-476d-9097-33ed21b5210c req-a36e6109-92fd-4bff-98dc-3230603cd7e6 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:20.995161 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-6236258e-2c0c-476d-9097-33ed21b5210c req-a36e6109-92fd-4bff-98dc-3230603cd7e6 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:21.007076 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a07a969c-79ba-4509-9825-46345e37343a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:21.020009 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-6236258e-2c0c-476d-9097-33ed21b5210c req-a36e6109-92fd-4bff-98dc-3230603cd7e6 service nova] Creating event network-vif-deleted:09a5433d-8875-4b65-bf36-ec574c211097 for instance 4f4546a4-8930-4f69-8f88-e4b23dc9d21c on hv-cinder-82099 Oct 11 12:02:21.024757 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a07a969c-79ba-4509-9825-46345e37343a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1522 microversion: 2.1 time: 0.261025 Oct 11 12:02:21.025524 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-6236258e-2c0c-476d-9097-33ed21b5210c req-a36e6109-92fd-4bff-98dc-3230603cd7e6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050931 Oct 11 12:02:21.026537 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 146/284] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:20 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:21.027113 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 139/285] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:02:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 12:02:21.553682 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-edb65d04-4c0b-4699-9d3f-211a36a97326 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:21.554356 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-edb65d04-4c0b-4699-9d3f-211a36a97326 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:21.561520 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-edb65d04-4c0b-4699-9d3f-211a36a97326 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:21.562020 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-edb65d04-4c0b-4699-9d3f-211a36a97326 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:21.562451 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-edb65d04-4c0b-4699-9d3f-211a36a97326 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:21.563204 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-edb65d04-4c0b-4699-9d3f-211a36a97326 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:21.563714 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-edb65d04-4c0b-4699-9d3f-211a36a97326 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:21.564179 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-edb65d04-4c0b-4699-9d3f-211a36a97326 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:21.656428 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-b8f017f2-214d-4e0a-aa9b-a0e5b385e0d3 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:21.657965 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-b8f017f2-214d-4e0a-aa9b-a0e5b385e0d3 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:21.671798 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b8f017f2-214d-4e0a-aa9b-a0e5b385e0d3 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:21.672958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b8f017f2-214d-4e0a-aa9b-a0e5b385e0d3 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:21.673944 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b8f017f2-214d-4e0a-aa9b-a0e5b385e0d3 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:21.675665 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b8f017f2-214d-4e0a-aa9b-a0e5b385e0d3 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:21.676699 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b8f017f2-214d-4e0a-aa9b-a0e5b385e0d3 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:21.677648 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b8f017f2-214d-4e0a-aa9b-a0e5b385e0d3 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:21.685893 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:02:21.760272 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-edb65d04-4c0b-4699-9d3f-211a36a97326 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:21.780299 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-edb65d04-4c0b-4699-9d3f-211a36a97326 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1363 microversion: 2.1 time: 0.230072 Oct 11 12:02:21.781825 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 147/286] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:21 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1363 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:21.811780 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-b8f017f2-214d-4e0a-aa9b-a0e5b385e0d3 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:21.821585 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-b8f017f2-214d-4e0a-aa9b-a0e5b385e0d3 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1461 microversion: 2.1 time: 0.174522 Oct 11 12:02:21.823008 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 140/287] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:21 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1461 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:22.060840 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-bcc3bc39-059f-4d37-b3ea-1f19db962ea6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:22.061838 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-bcc3bc39-059f-4d37-b3ea-1f19db962ea6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:22.071305 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bcc3bc39-059f-4d37-b3ea-1f19db962ea6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:22.071910 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bcc3bc39-059f-4d37-b3ea-1f19db962ea6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:22.072577 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bcc3bc39-059f-4d37-b3ea-1f19db962ea6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:22.073573 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bcc3bc39-059f-4d37-b3ea-1f19db962ea6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:22.074122 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bcc3bc39-059f-4d37-b3ea-1f19db962ea6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:22.074706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bcc3bc39-059f-4d37-b3ea-1f19db962ea6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:22.226061 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-bcc3bc39-059f-4d37-b3ea-1f19db962ea6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:22.234200 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-bcc3bc39-059f-4d37-b3ea-1f19db962ea6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1522 microversion: 2.1 time: 0.180011 Oct 11 12:02:22.234821 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 148/288] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:22 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:22.805109 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-1edcfa67-8802-47e2-a6c0-131aab091b63 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:22.805722 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-1edcfa67-8802-47e2-a6c0-131aab091b63 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:22.812357 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1edcfa67-8802-47e2-a6c0-131aab091b63 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:22.812889 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1edcfa67-8802-47e2-a6c0-131aab091b63 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:22.813320 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1edcfa67-8802-47e2-a6c0-131aab091b63 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:22.814047 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1edcfa67-8802-47e2-a6c0-131aab091b63 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:22.814497 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1edcfa67-8802-47e2-a6c0-131aab091b63 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:22.814958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1edcfa67-8802-47e2-a6c0-131aab091b63 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:22.845842 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-203cb5ed-9e19-4b45-97b8-afcb9a6068fc tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:22.846838 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-203cb5ed-9e19-4b45-97b8-afcb9a6068fc tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:22.858990 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-203cb5ed-9e19-4b45-97b8-afcb9a6068fc tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:22.859843 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-203cb5ed-9e19-4b45-97b8-afcb9a6068fc tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:22.860631 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-203cb5ed-9e19-4b45-97b8-afcb9a6068fc tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:22.861880 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-203cb5ed-9e19-4b45-97b8-afcb9a6068fc tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:22.862692 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-203cb5ed-9e19-4b45-97b8-afcb9a6068fc tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:22.863421 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-203cb5ed-9e19-4b45-97b8-afcb9a6068fc tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:22.947454 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-203cb5ed-9e19-4b45-97b8-afcb9a6068fc tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:22.958315 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-203cb5ed-9e19-4b45-97b8-afcb9a6068fc tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1461 microversion: 2.1 time: 0.116201 Oct 11 12:02:22.971437 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 149/289] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:22 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1461 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:22.985246 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-1edcfa67-8802-47e2-a6c0-131aab091b63 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:22.994708 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-1edcfa67-8802-47e2-a6c0-131aab091b63 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1363 microversion: 2.1 time: 0.193587 Oct 11 12:02:22.995299 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 141/290] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:22 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:23.258402 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-65d2b662-7c38-4a2e-b3e5-70d76961406b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:23.259146 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-65d2b662-7c38-4a2e-b3e5-70d76961406b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:23.266221 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-65d2b662-7c38-4a2e-b3e5-70d76961406b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:23.266798 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-65d2b662-7c38-4a2e-b3e5-70d76961406b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:23.267266 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-65d2b662-7c38-4a2e-b3e5-70d76961406b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:23.268009 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-65d2b662-7c38-4a2e-b3e5-70d76961406b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:23.268491 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-65d2b662-7c38-4a2e-b3e5-70d76961406b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:23.268914 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-65d2b662-7c38-4a2e-b3e5-70d76961406b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:23.423417 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-65d2b662-7c38-4a2e-b3e5-70d76961406b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:23.431666 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-65d2b662-7c38-4a2e-b3e5-70d76961406b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1522 microversion: 2.1 time: 0.177823 Oct 11 12:02:23.432258 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 150/291] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:23 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:23.981562 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-4695c117-2871-48a9-8cbc-39b15890f706 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:23.982343 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-4695c117-2871-48a9-8cbc-39b15890f706 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:23.991903 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4695c117-2871-48a9-8cbc-39b15890f706 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:23.992562 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4695c117-2871-48a9-8cbc-39b15890f706 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:23.993291 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4695c117-2871-48a9-8cbc-39b15890f706 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:23.994331 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4695c117-2871-48a9-8cbc-39b15890f706 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:23.994969 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4695c117-2871-48a9-8cbc-39b15890f706 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:23.995541 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4695c117-2871-48a9-8cbc-39b15890f706 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:24.028633 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0baa58db-a0b3-48aa-aa14-7c03b3cb65be tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:24.029486 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0baa58db-a0b3-48aa-aa14-7c03b3cb65be tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:24.037241 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0baa58db-a0b3-48aa-aa14-7c03b3cb65be tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:24.037836 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0baa58db-a0b3-48aa-aa14-7c03b3cb65be tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:24.038368 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0baa58db-a0b3-48aa-aa14-7c03b3cb65be tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:24.039173 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0baa58db-a0b3-48aa-aa14-7c03b3cb65be tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:24.039701 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0baa58db-a0b3-48aa-aa14-7c03b3cb65be tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:24.040300 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0baa58db-a0b3-48aa-aa14-7c03b3cb65be tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:24.084543 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-4695c117-2871-48a9-8cbc-39b15890f706 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:24.100196 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-4695c117-2871-48a9-8cbc-39b15890f706 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1461 microversion: 2.1 time: 0.122422 Oct 11 12:02:24.101064 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 142/292] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:23 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1461 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:24.334575 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0baa58db-a0b3-48aa-aa14-7c03b3cb65be tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:24.345238 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0baa58db-a0b3-48aa-aa14-7c03b3cb65be tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1363 microversion: 2.1 time: 0.320831 Oct 11 12:02:24.345831 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 151/293] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:24 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1363 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:24.454549 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-c9891d0d-dde3-4508-b0d2-9293311c844e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:24.455139 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-c9891d0d-dde3-4508-b0d2-9293311c844e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:24.462392 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c9891d0d-dde3-4508-b0d2-9293311c844e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:24.462989 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c9891d0d-dde3-4508-b0d2-9293311c844e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:24.463431 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c9891d0d-dde3-4508-b0d2-9293311c844e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:24.464200 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c9891d0d-dde3-4508-b0d2-9293311c844e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:24.464662 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c9891d0d-dde3-4508-b0d2-9293311c844e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:24.465100 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c9891d0d-dde3-4508-b0d2-9293311c844e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:24.605037 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-c9891d0d-dde3-4508-b0d2-9293311c844e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:24.613670 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-c9891d0d-dde3-4508-b0d2-9293311c844e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1522 microversion: 2.1 time: 0.163128 Oct 11 12:02:24.614367 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 143/294] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:24 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:25.137198 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-de97515d-fdb9-4265-8ea6-e3d625d6722f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:25.138226 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-de97515d-fdb9-4265-8ea6-e3d625d6722f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:25.147942 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-de97515d-fdb9-4265-8ea6-e3d625d6722f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:25.148996 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-de97515d-fdb9-4265-8ea6-e3d625d6722f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:25.149930 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-de97515d-fdb9-4265-8ea6-e3d625d6722f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:25.151683 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-de97515d-fdb9-4265-8ea6-e3d625d6722f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:25.157837 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-de97515d-fdb9-4265-8ea6-e3d625d6722f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:25.158668 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-de97515d-fdb9-4265-8ea6-e3d625d6722f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:25.282209 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-de97515d-fdb9-4265-8ea6-e3d625d6722f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:25.287852 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=100 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:02:25.297590 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-de97515d-fdb9-4265-8ea6-e3d625d6722f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1461 microversion: 2.1 time: 0.164319 Oct 11 12:02:25.299120 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 152/295] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:25 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1461 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:25.368311 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-cf3a3096-dad0-4e27-bd83-b057bc2b01b7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:25.368919 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-cf3a3096-dad0-4e27-bd83-b057bc2b01b7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:25.375056 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cf3a3096-dad0-4e27-bd83-b057bc2b01b7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:25.375535 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cf3a3096-dad0-4e27-bd83-b057bc2b01b7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:25.376636 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cf3a3096-dad0-4e27-bd83-b057bc2b01b7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:25.377377 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cf3a3096-dad0-4e27-bd83-b057bc2b01b7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:25.377917 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cf3a3096-dad0-4e27-bd83-b057bc2b01b7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:25.378259 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cf3a3096-dad0-4e27-bd83-b057bc2b01b7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:25.596250 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-cf3a3096-dad0-4e27-bd83-b057bc2b01b7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:25.616230 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-cf3a3096-dad0-4e27-bd83-b057bc2b01b7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1363 microversion: 2.1 time: 0.251222 Oct 11 12:02:25.625310 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 144/296] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:25 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1363 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:25.667493 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c21999fd-aa69-437f-8d37-9d0cbd9b8e38 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:25.668673 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c21999fd-aa69-437f-8d37-9d0cbd9b8e38 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:25.698149 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c21999fd-aa69-437f-8d37-9d0cbd9b8e38 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:25.699064 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c21999fd-aa69-437f-8d37-9d0cbd9b8e38 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:25.699876 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c21999fd-aa69-437f-8d37-9d0cbd9b8e38 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:25.701137 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c21999fd-aa69-437f-8d37-9d0cbd9b8e38 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:25.702171 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c21999fd-aa69-437f-8d37-9d0cbd9b8e38 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:25.702942 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c21999fd-aa69-437f-8d37-9d0cbd9b8e38 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:26.129381 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c21999fd-aa69-437f-8d37-9d0cbd9b8e38 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:26.143400 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c21999fd-aa69-437f-8d37-9d0cbd9b8e38 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1522 microversion: 2.1 time: 0.501761 Oct 11 12:02:26.144570 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 153/297] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:25 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1522 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:26.334092 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-a2cd8958-ad9c-47ac-9308-da39e472fe6f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:26.335174 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-a2cd8958-ad9c-47ac-9308-da39e472fe6f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:26.344673 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a2cd8958-ad9c-47ac-9308-da39e472fe6f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:26.345458 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a2cd8958-ad9c-47ac-9308-da39e472fe6f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:26.346130 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a2cd8958-ad9c-47ac-9308-da39e472fe6f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:26.347229 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a2cd8958-ad9c-47ac-9308-da39e472fe6f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:26.347949 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a2cd8958-ad9c-47ac-9308-da39e472fe6f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:26.348595 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a2cd8958-ad9c-47ac-9308-da39e472fe6f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:26.383098 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a2cd8958-ad9c-47ac-9308-da39e472fe6f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:26.384012 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a2cd8958-ad9c-47ac-9308-da39e472fe6f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:26.384012 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a2cd8958-ad9c-47ac-9308-da39e472fe6f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:26.384286 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.objects.instance [None req-a2cd8958-ad9c-47ac-9308-da39e472fe6f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lazy-loading 'fault' on Instance uuid 4f4546a4-8930-4f69-8f88-e4b23dc9d21c {{(pid=118994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:02:26.432706 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-a2cd8958-ad9c-47ac-9308-da39e472fe6f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:26.440621 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-a2cd8958-ad9c-47ac-9308-da39e472fe6f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1304 microversion: 2.1 time: 0.111654 Oct 11 12:02:26.441233 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 145/298] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:26 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:26.669850 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a56fec7f-de24-40cc-85ac-946beaa80e9b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:26.670602 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a56fec7f-de24-40cc-85ac-946beaa80e9b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:26.679409 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a56fec7f-de24-40cc-85ac-946beaa80e9b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:26.679903 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a56fec7f-de24-40cc-85ac-946beaa80e9b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:26.680343 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a56fec7f-de24-40cc-85ac-946beaa80e9b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:26.681093 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a56fec7f-de24-40cc-85ac-946beaa80e9b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:26.681522 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a56fec7f-de24-40cc-85ac-946beaa80e9b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:26.682437 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a56fec7f-de24-40cc-85ac-946beaa80e9b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:26.892034 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a56fec7f-de24-40cc-85ac-946beaa80e9b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:26.902306 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a56fec7f-de24-40cc-85ac-946beaa80e9b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1363 microversion: 2.1 time: 0.236672 Oct 11 12:02:26.903175 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 154/299] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:26 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:27.168968 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-2d893aef-10ea-4c9e-8ca0-252c3c0b00ba tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:27.169738 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-2d893aef-10ea-4c9e-8ca0-252c3c0b00ba tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:27.177696 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2d893aef-10ea-4c9e-8ca0-252c3c0b00ba tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:27.179118 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2d893aef-10ea-4c9e-8ca0-252c3c0b00ba tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:27.179701 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2d893aef-10ea-4c9e-8ca0-252c3c0b00ba tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:27.180666 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2d893aef-10ea-4c9e-8ca0-252c3c0b00ba tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:27.181129 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2d893aef-10ea-4c9e-8ca0-252c3c0b00ba tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:27.181540 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2d893aef-10ea-4c9e-8ca0-252c3c0b00ba tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:27.391563 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-2d893aef-10ea-4c9e-8ca0-252c3c0b00ba tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:27.400392 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-2d893aef-10ea-4c9e-8ca0-252c3c0b00ba tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1522 microversion: 2.1 time: 0.236131 Oct 11 12:02:27.401802 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 146/300] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:27 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:02:27.466051 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8ee7edd1-66bf-4653-a5d2-b79cb6c0b39b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:27.466813 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8ee7edd1-66bf-4653-a5d2-b79cb6c0b39b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:27.474204 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8ee7edd1-66bf-4653-a5d2-b79cb6c0b39b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:27.474833 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8ee7edd1-66bf-4653-a5d2-b79cb6c0b39b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:27.475330 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8ee7edd1-66bf-4653-a5d2-b79cb6c0b39b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:27.476094 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8ee7edd1-66bf-4653-a5d2-b79cb6c0b39b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:27.476807 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8ee7edd1-66bf-4653-a5d2-b79cb6c0b39b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:27.477447 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8ee7edd1-66bf-4653-a5d2-b79cb6c0b39b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:27.512834 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8ee7edd1-66bf-4653-a5d2-b79cb6c0b39b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:27.513459 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8ee7edd1-66bf-4653-a5d2-b79cb6c0b39b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:27.514026 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8ee7edd1-66bf-4653-a5d2-b79cb6c0b39b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:27.514574 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-8ee7edd1-66bf-4653-a5d2-b79cb6c0b39b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lazy-loading 'fault' on Instance uuid 4f4546a4-8930-4f69-8f88-e4b23dc9d21c {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:02:27.579972 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8ee7edd1-66bf-4653-a5d2-b79cb6c0b39b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:27.589710 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8ee7edd1-66bf-4653-a5d2-b79cb6c0b39b tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1304 microversion: 2.1 time: 0.129022 Oct 11 12:02:27.590896 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 155/301] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:27 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1304 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:27.939330 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-b341c7cb-ff80-45f0-8327-77819cd40c80 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:27.940499 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-b341c7cb-ff80-45f0-8327-77819cd40c80 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:27.953155 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b341c7cb-ff80-45f0-8327-77819cd40c80 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:27.954052 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b341c7cb-ff80-45f0-8327-77819cd40c80 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:27.954838 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b341c7cb-ff80-45f0-8327-77819cd40c80 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:27.956152 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b341c7cb-ff80-45f0-8327-77819cd40c80 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:27.957034 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b341c7cb-ff80-45f0-8327-77819cd40c80 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:27.957550 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b341c7cb-ff80-45f0-8327-77819cd40c80 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:28.305156 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-b341c7cb-ff80-45f0-8327-77819cd40c80 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:28.316914 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-b341c7cb-ff80-45f0-8327-77819cd40c80 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1363 microversion: 2.1 time: 0.385632 Oct 11 12:02:28.317926 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 147/302] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:27 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1363 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:28.446445 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a49edce5-57a1-432c-9922-64efae48cb84 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:28.447405 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a49edce5-57a1-432c-9922-64efae48cb84 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:28.457670 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a49edce5-57a1-432c-9922-64efae48cb84 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:28.458445 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a49edce5-57a1-432c-9922-64efae48cb84 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:28.459798 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a49edce5-57a1-432c-9922-64efae48cb84 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:28.461175 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a49edce5-57a1-432c-9922-64efae48cb84 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:28.461771 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a49edce5-57a1-432c-9922-64efae48cb84 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:28.462321 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a49edce5-57a1-432c-9922-64efae48cb84 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:28.638059 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-a2de1e26-e15f-46db-9f58-1705d4fc18a9 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:28.639304 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-a2de1e26-e15f-46db-9f58-1705d4fc18a9 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:28.650268 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a2de1e26-e15f-46db-9f58-1705d4fc18a9 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:28.651953 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a2de1e26-e15f-46db-9f58-1705d4fc18a9 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:28.652920 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a2de1e26-e15f-46db-9f58-1705d4fc18a9 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:28.654254 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a2de1e26-e15f-46db-9f58-1705d4fc18a9 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:28.655218 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a2de1e26-e15f-46db-9f58-1705d4fc18a9 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:28.655996 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a2de1e26-e15f-46db-9f58-1705d4fc18a9 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:28.699194 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a2de1e26-e15f-46db-9f58-1705d4fc18a9 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:28.699678 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a2de1e26-e15f-46db-9f58-1705d4fc18a9 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:28.700106 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a2de1e26-e15f-46db-9f58-1705d4fc18a9 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:28.700562 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.objects.instance [None req-a2de1e26-e15f-46db-9f58-1705d4fc18a9 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lazy-loading 'fault' on Instance uuid 4f4546a4-8930-4f69-8f88-e4b23dc9d21c {{(pid=118994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:02:28.701833 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a49edce5-57a1-432c-9922-64efae48cb84 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:28.717096 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a49edce5-57a1-432c-9922-64efae48cb84 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1522 microversion: 2.1 time: 0.276852 Oct 11 12:02:28.718077 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 156/303] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:28 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:28.767658 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-a2de1e26-e15f-46db-9f58-1705d4fc18a9 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:28.777797 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-a2de1e26-e15f-46db-9f58-1705d4fc18a9 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1304 microversion: 2.1 time: 0.148133 Oct 11 12:02:28.778646 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 148/304] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:28 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1304 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:29.347328 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-75c4750a-f835-41a7-8240-4e2a0c185e08 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:29.348164 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-75c4750a-f835-41a7-8240-4e2a0c185e08 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:29.354712 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-75c4750a-f835-41a7-8240-4e2a0c185e08 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:29.355203 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-75c4750a-f835-41a7-8240-4e2a0c185e08 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:29.355623 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-75c4750a-f835-41a7-8240-4e2a0c185e08 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:29.356326 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-75c4750a-f835-41a7-8240-4e2a0c185e08 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:29.356766 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-75c4750a-f835-41a7-8240-4e2a0c185e08 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:29.357177 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-75c4750a-f835-41a7-8240-4e2a0c185e08 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:29.532058 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-75c4750a-f835-41a7-8240-4e2a0c185e08 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:29.540201 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-75c4750a-f835-41a7-8240-4e2a0c185e08 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1363 microversion: 2.1 time: 0.196866 Oct 11 12:02:29.540782 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 157/305] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:29 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:02:29.755843 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-5b456d7b-654f-424c-b990-b7c87c468ea5 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:29.757143 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-5b456d7b-654f-424c-b990-b7c87c468ea5 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:29.767731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5b456d7b-654f-424c-b990-b7c87c468ea5 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:29.768544 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5b456d7b-654f-424c-b990-b7c87c468ea5 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:29.769654 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5b456d7b-654f-424c-b990-b7c87c468ea5 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:29.770352 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5b456d7b-654f-424c-b990-b7c87c468ea5 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:29.771148 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5b456d7b-654f-424c-b990-b7c87c468ea5 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:29.771875 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5b456d7b-654f-424c-b990-b7c87c468ea5 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:29.807141 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c5b634fc-5046-44f7-b3f0-fb2b5c820218 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:29.808195 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c5b634fc-5046-44f7-b3f0-fb2b5c820218 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:29.819429 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c5b634fc-5046-44f7-b3f0-fb2b5c820218 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:29.820435 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c5b634fc-5046-44f7-b3f0-fb2b5c820218 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:29.821075 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c5b634fc-5046-44f7-b3f0-fb2b5c820218 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:29.822041 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c5b634fc-5046-44f7-b3f0-fb2b5c820218 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:29.822750 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c5b634fc-5046-44f7-b3f0-fb2b5c820218 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:29.823370 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c5b634fc-5046-44f7-b3f0-fb2b5c820218 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:29.864675 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c5b634fc-5046-44f7-b3f0-fb2b5c820218 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:29.865433 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c5b634fc-5046-44f7-b3f0-fb2b5c820218 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:29.866170 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c5b634fc-5046-44f7-b3f0-fb2b5c820218 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:29.866898 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-c5b634fc-5046-44f7-b3f0-fb2b5c820218 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lazy-loading 'fault' on Instance uuid 4f4546a4-8930-4f69-8f88-e4b23dc9d21c {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:02:29.951840 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c5b634fc-5046-44f7-b3f0-fb2b5c820218 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:29.986753 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c5b634fc-5046-44f7-b3f0-fb2b5c820218 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1304 microversion: 2.1 time: 0.186439 Oct 11 12:02:29.987745 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 158/306] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:29 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1304 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:30.049452 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-5b456d7b-654f-424c-b990-b7c87c468ea5 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:30.059450 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-5b456d7b-654f-424c-b990-b7c87c468ea5 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1522 microversion: 2.1 time: 0.311415 Oct 11 12:02:30.060188 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 149/307] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:29 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:30.565058 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7f7a3752-8b05-40c4-b95e-b3fc7163a7d0 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:30.565883 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7f7a3752-8b05-40c4-b95e-b3fc7163a7d0 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:30.587024 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7f7a3752-8b05-40c4-b95e-b3fc7163a7d0 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:30.588560 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7f7a3752-8b05-40c4-b95e-b3fc7163a7d0 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:30.591314 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7f7a3752-8b05-40c4-b95e-b3fc7163a7d0 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:30.593683 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7f7a3752-8b05-40c4-b95e-b3fc7163a7d0 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:30.594969 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7f7a3752-8b05-40c4-b95e-b3fc7163a7d0 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:30.596111 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7f7a3752-8b05-40c4-b95e-b3fc7163a7d0 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:30.788500 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7f7a3752-8b05-40c4-b95e-b3fc7163a7d0 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:30.797485 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7f7a3752-8b05-40c4-b95e-b3fc7163a7d0 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1363 microversion: 2.1 time: 0.236616 Oct 11 12:02:30.798133 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 159/308] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:30 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:31.030605 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-6820e4d7-ece6-4f13-a2f2-33bbfb8a07ef tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:31.031516 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-6820e4d7-ece6-4f13-a2f2-33bbfb8a07ef tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:31.038747 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6820e4d7-ece6-4f13-a2f2-33bbfb8a07ef tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:31.039243 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6820e4d7-ece6-4f13-a2f2-33bbfb8a07ef tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:31.039699 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6820e4d7-ece6-4f13-a2f2-33bbfb8a07ef tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:31.040407 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6820e4d7-ece6-4f13-a2f2-33bbfb8a07ef tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:31.040858 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6820e4d7-ece6-4f13-a2f2-33bbfb8a07ef tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:31.041279 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6820e4d7-ece6-4f13-a2f2-33bbfb8a07ef tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:31.083962 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6820e4d7-ece6-4f13-a2f2-33bbfb8a07ef tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:31.084452 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6820e4d7-ece6-4f13-a2f2-33bbfb8a07ef tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:31.084753 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9846eda3-70ce-4055-bc98-d2bd90e86bf9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:31.085348 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6820e4d7-ece6-4f13-a2f2-33bbfb8a07ef tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:31.085436 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9846eda3-70ce-4055-bc98-d2bd90e86bf9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:31.085727 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.objects.instance [None req-6820e4d7-ece6-4f13-a2f2-33bbfb8a07ef tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lazy-loading 'fault' on Instance uuid 4f4546a4-8930-4f69-8f88-e4b23dc9d21c {{(pid=118994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:02:31.092965 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9846eda3-70ce-4055-bc98-d2bd90e86bf9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:31.093482 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9846eda3-70ce-4055-bc98-d2bd90e86bf9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:31.094001 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9846eda3-70ce-4055-bc98-d2bd90e86bf9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:31.094799 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9846eda3-70ce-4055-bc98-d2bd90e86bf9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:31.095257 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9846eda3-70ce-4055-bc98-d2bd90e86bf9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:31.095679 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9846eda3-70ce-4055-bc98-d2bd90e86bf9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:31.147975 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-6820e4d7-ece6-4f13-a2f2-33bbfb8a07ef tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:31.158382 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-6820e4d7-ece6-4f13-a2f2-33bbfb8a07ef tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1304 microversion: 2.1 time: 0.137810 Oct 11 12:02:31.159047 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 150/309] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:31 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1304 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:31.293508 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-9846eda3-70ce-4055-bc98-d2bd90e86bf9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:31.304361 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9846eda3-70ce-4055-bc98-d2bd90e86bf9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1522 microversion: 2.1 time: 0.224004 Oct 11 12:02:31.305473 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 160/310] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:31 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:31.821764 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-69545e14-f70d-497d-a1be-d413e222012c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:31.822373 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-69545e14-f70d-497d-a1be-d413e222012c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:31.830133 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-69545e14-f70d-497d-a1be-d413e222012c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:31.830889 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-69545e14-f70d-497d-a1be-d413e222012c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:31.831503 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-69545e14-f70d-497d-a1be-d413e222012c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:31.832472 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-69545e14-f70d-497d-a1be-d413e222012c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:31.833062 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-69545e14-f70d-497d-a1be-d413e222012c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:31.833668 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-69545e14-f70d-497d-a1be-d413e222012c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:31.990375 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-69545e14-f70d-497d-a1be-d413e222012c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:31.999420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-69545e14-f70d-497d-a1be-d413e222012c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1363 microversion: 2.1 time: 0.181549 Oct 11 12:02:32.000034 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 151/311] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:31 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1363 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:32.213869 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b7a7efb2-38b2-4467-92be-75ea42334132 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:32.215143 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-b7a7efb2-38b2-4467-92be-75ea42334132 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:32.228245 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b7a7efb2-38b2-4467-92be-75ea42334132 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:32.229108 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b7a7efb2-38b2-4467-92be-75ea42334132 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:32.229853 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b7a7efb2-38b2-4467-92be-75ea42334132 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:32.231111 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b7a7efb2-38b2-4467-92be-75ea42334132 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:32.231937 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b7a7efb2-38b2-4467-92be-75ea42334132 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:32.232757 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b7a7efb2-38b2-4467-92be-75ea42334132 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:32.275249 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b7a7efb2-38b2-4467-92be-75ea42334132 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:32.276096 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b7a7efb2-38b2-4467-92be-75ea42334132 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:32.276521 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b7a7efb2-38b2-4467-92be-75ea42334132 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:32.276973 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-b7a7efb2-38b2-4467-92be-75ea42334132 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lazy-loading 'fault' on Instance uuid 4f4546a4-8930-4f69-8f88-e4b23dc9d21c {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:02:32.328937 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-2b7ad6b6-38fc-4304-a19e-a07d5927c33c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:32.329546 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-2b7ad6b6-38fc-4304-a19e-a07d5927c33c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:32.331735 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-b7a7efb2-38b2-4467-92be-75ea42334132 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:32.336213 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2b7ad6b6-38fc-4304-a19e-a07d5927c33c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:32.336692 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2b7ad6b6-38fc-4304-a19e-a07d5927c33c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:32.337332 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2b7ad6b6-38fc-4304-a19e-a07d5927c33c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:32.338068 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2b7ad6b6-38fc-4304-a19e-a07d5927c33c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:32.338605 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2b7ad6b6-38fc-4304-a19e-a07d5927c33c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:32.339239 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2b7ad6b6-38fc-4304-a19e-a07d5927c33c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:32.342410 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b7a7efb2-38b2-4467-92be-75ea42334132 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1304 microversion: 2.1 time: 0.142015 Oct 11 12:02:32.343392 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 161/312] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:32 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1304 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:32.500015 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-2b7ad6b6-38fc-4304-a19e-a07d5927c33c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:32.513416 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-2b7ad6b6-38fc-4304-a19e-a07d5927c33c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1522 microversion: 2.1 time: 0.188762 Oct 11 12:02:32.514097 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 152/313] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:32 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:02:33.027194 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ebccfb3c-d051-4ec8-acc2-e298dcd80676 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:33.028183 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ebccfb3c-d051-4ec8-acc2-e298dcd80676 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:33.040427 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ebccfb3c-d051-4ec8-acc2-e298dcd80676 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:33.041883 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ebccfb3c-d051-4ec8-acc2-e298dcd80676 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:33.042841 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ebccfb3c-d051-4ec8-acc2-e298dcd80676 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:33.044001 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ebccfb3c-d051-4ec8-acc2-e298dcd80676 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:33.044742 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ebccfb3c-d051-4ec8-acc2-e298dcd80676 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:33.045573 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ebccfb3c-d051-4ec8-acc2-e298dcd80676 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:33.380964 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-7a3ff9bb-221b-4ce9-84f8-ae72bb23b301 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:33.383165 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-7a3ff9bb-221b-4ce9-84f8-ae72bb23b301 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:33.394260 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7a3ff9bb-221b-4ce9-84f8-ae72bb23b301 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:33.395572 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7a3ff9bb-221b-4ce9-84f8-ae72bb23b301 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:33.396386 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7a3ff9bb-221b-4ce9-84f8-ae72bb23b301 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:33.397761 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7a3ff9bb-221b-4ce9-84f8-ae72bb23b301 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:33.398647 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7a3ff9bb-221b-4ce9-84f8-ae72bb23b301 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:33.399453 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7a3ff9bb-221b-4ce9-84f8-ae72bb23b301 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:33.453278 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:02:33.460416 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7a3ff9bb-221b-4ce9-84f8-ae72bb23b301 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:33.460893 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7a3ff9bb-221b-4ce9-84f8-ae72bb23b301 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:33.461320 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7a3ff9bb-221b-4ce9-84f8-ae72bb23b301 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:33.461771 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.objects.instance [None req-7a3ff9bb-221b-4ce9-84f8-ae72bb23b301 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lazy-loading 'fault' on Instance uuid 4f4546a4-8930-4f69-8f88-e4b23dc9d21c {{(pid=118994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:02:33.479578 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ebccfb3c-d051-4ec8-acc2-e298dcd80676 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:33.497821 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ebccfb3c-d051-4ec8-acc2-e298dcd80676 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1363 microversion: 2.1 time: 0.477386 Oct 11 12:02:33.499754 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 162/314] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:33 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1363 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:33.537826 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d1c0b907-d853-412a-922e-51aff417a365 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:33.538483 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d1c0b907-d853-412a-922e-51aff417a365 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:33.539826 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-7a3ff9bb-221b-4ce9-84f8-ae72bb23b301 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:33.545318 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d1c0b907-d853-412a-922e-51aff417a365 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:33.545848 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d1c0b907-d853-412a-922e-51aff417a365 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:33.546318 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d1c0b907-d853-412a-922e-51aff417a365 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:33.547081 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d1c0b907-d853-412a-922e-51aff417a365 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:33.547534 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d1c0b907-d853-412a-922e-51aff417a365 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:33.547953 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d1c0b907-d853-412a-922e-51aff417a365 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:33.551519 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-7a3ff9bb-221b-4ce9-84f8-ae72bb23b301 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1304 microversion: 2.1 time: 0.178875 Oct 11 12:02:33.552483 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 153/315] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:33 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1304 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:02:33.704908 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d1c0b907-d853-412a-922e-51aff417a365 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:33.725030 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d1c0b907-d853-412a-922e-51aff417a365 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1522 microversion: 2.1 time: 0.191080 Oct 11 12:02:33.726087 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 163/316] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:33 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:34.522629 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-6950c523-6cc7-4766-acb6-8c0b6bbd5dd3 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:34.523265 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-6950c523-6cc7-4766-acb6-8c0b6bbd5dd3 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:34.530622 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6950c523-6cc7-4766-acb6-8c0b6bbd5dd3 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:34.531202 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6950c523-6cc7-4766-acb6-8c0b6bbd5dd3 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:34.531704 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6950c523-6cc7-4766-acb6-8c0b6bbd5dd3 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:34.532532 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6950c523-6cc7-4766-acb6-8c0b6bbd5dd3 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:34.533016 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6950c523-6cc7-4766-acb6-8c0b6bbd5dd3 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:34.533561 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6950c523-6cc7-4766-acb6-8c0b6bbd5dd3 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:34.578543 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c20d7a83-d5cf-46dc-ae0e-e2595c8b1c03 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:34.579481 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c20d7a83-d5cf-46dc-ae0e-e2595c8b1c03 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:34.586506 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c20d7a83-d5cf-46dc-ae0e-e2595c8b1c03 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:34.587053 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c20d7a83-d5cf-46dc-ae0e-e2595c8b1c03 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:34.587473 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c20d7a83-d5cf-46dc-ae0e-e2595c8b1c03 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:34.588456 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c20d7a83-d5cf-46dc-ae0e-e2595c8b1c03 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:34.588921 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c20d7a83-d5cf-46dc-ae0e-e2595c8b1c03 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:34.589325 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c20d7a83-d5cf-46dc-ae0e-e2595c8b1c03 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:34.630303 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c20d7a83-d5cf-46dc-ae0e-e2595c8b1c03 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:34.631494 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c20d7a83-d5cf-46dc-ae0e-e2595c8b1c03 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:34.631494 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c20d7a83-d5cf-46dc-ae0e-e2595c8b1c03 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:34.631795 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-c20d7a83-d5cf-46dc-ae0e-e2595c8b1c03 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lazy-loading 'fault' on Instance uuid 4f4546a4-8930-4f69-8f88-e4b23dc9d21c {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:02:34.684622 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c20d7a83-d5cf-46dc-ae0e-e2595c8b1c03 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:34.698396 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-6950c523-6cc7-4766-acb6-8c0b6bbd5dd3 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:34.698815 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c20d7a83-d5cf-46dc-ae0e-e2595c8b1c03 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 200 len: 1304 microversion: 2.1 time: 0.124427 Oct 11 12:02:34.699863 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 164/317] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:34 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 1304 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:02:34.707420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-6950c523-6cc7-4766-acb6-8c0b6bbd5dd3 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1363 microversion: 2.1 time: 0.188983 Oct 11 12:02:34.708094 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 154/318] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:34 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:34.749562 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e2b4548d-1d23-4cc4-8c42-ee89a6b7afc0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:34.750170 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e2b4548d-1d23-4cc4-8c42-ee89a6b7afc0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:34.756876 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e2b4548d-1d23-4cc4-8c42-ee89a6b7afc0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:34.757358 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e2b4548d-1d23-4cc4-8c42-ee89a6b7afc0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:34.757792 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e2b4548d-1d23-4cc4-8c42-ee89a6b7afc0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:34.758499 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e2b4548d-1d23-4cc4-8c42-ee89a6b7afc0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:34.758991 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e2b4548d-1d23-4cc4-8c42-ee89a6b7afc0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:34.759412 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e2b4548d-1d23-4cc4-8c42-ee89a6b7afc0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:34.922171 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e2b4548d-1d23-4cc4-8c42-ee89a6b7afc0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:34.934991 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e2b4548d-1d23-4cc4-8c42-ee89a6b7afc0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1522 microversion: 2.1 time: 0.189693 Oct 11 12:02:34.936064 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 165/319] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:34 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:35.353356 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-31cb208a-1f2f-414c-9432-b61f0626c792 req-bf6216c6-10ba-43af-bee0-a0526c3b2454 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3277e26-d502-49fd-ba21-b427effd9d91", "name": "network-vif-plugged", "status": "completed", "tag": "8addee64-ef1f-4a6a-8f09-b378e453cff5"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:02:35.397938 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-31cb208a-1f2f-414c-9432-b61f0626c792 req-bf6216c6-10ba-43af-bee0-a0526c3b2454 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:35.398876 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-31cb208a-1f2f-414c-9432-b61f0626c792 req-bf6216c6-10ba-43af-bee0-a0526c3b2454 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:35.399513 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-31cb208a-1f2f-414c-9432-b61f0626c792 req-bf6216c6-10ba-43af-bee0-a0526c3b2454 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:35.439398 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-31cb208a-1f2f-414c-9432-b61f0626c792 req-bf6216c6-10ba-43af-bee0-a0526c3b2454 service nova] Creating event network-vif-plugged:8addee64-ef1f-4a6a-8f09-b378e453cff5 for instance e3277e26-d502-49fd-ba21-b427effd9d91 on hv-cinder-82099 Oct 11 12:02:35.449240 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-31cb208a-1f2f-414c-9432-b61f0626c792 req-bf6216c6-10ba-43af-bee0-a0526c3b2454 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105872 Oct 11 12:02:35.450745 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 155/320] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:02:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:02:35.735937 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-77bc1a71-ddf5-4e2f-b367-5fd9ea03d32e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:35.736941 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-77bc1a71-ddf5-4e2f-b367-5fd9ea03d32e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:35.737835 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-d357070e-04a6-45a9-92b7-3f780688d2b6 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:35.738752 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-d357070e-04a6-45a9-92b7-3f780688d2b6 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: 4f4546a4-8930-4f69-8f88-e4b23dc9d21c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:35.746316 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-77bc1a71-ddf5-4e2f-b367-5fd9ea03d32e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:35.746812 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-77bc1a71-ddf5-4e2f-b367-5fd9ea03d32e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:35.747255 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-77bc1a71-ddf5-4e2f-b367-5fd9ea03d32e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:35.748034 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-77bc1a71-ddf5-4e2f-b367-5fd9ea03d32e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:35.748494 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-77bc1a71-ddf5-4e2f-b367-5fd9ea03d32e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:35.748655 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d357070e-04a6-45a9-92b7-3f780688d2b6 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:35.748909 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-77bc1a71-ddf5-4e2f-b367-5fd9ea03d32e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:35.749073 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d357070e-04a6-45a9-92b7-3f780688d2b6 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:35.749441 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d357070e-04a6-45a9-92b7-3f780688d2b6 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:35.750152 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d357070e-04a6-45a9-92b7-3f780688d2b6 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:35.750671 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d357070e-04a6-45a9-92b7-3f780688d2b6 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:35.751098 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d357070e-04a6-45a9-92b7-3f780688d2b6 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:35.755938 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=100 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:02:35.767635 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.wsgi [None req-d357070e-04a6-45a9-92b7-3f780688d2b6 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] HTTP exception thrown: Instance 4f4546a4-8930-4f69-8f88-e4b23dc9d21c could not be found. Oct 11 12:02:35.769550 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-d357070e-04a6-45a9-92b7-3f780688d2b6 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Request method failure captured: Oct 11 12:02:35.769550 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: request: GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c HTTP/1.1 Oct 11 12:02:35.769550 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept: application/json Oct 11 12:02:35.769550 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept-Encoding: identity Oct 11 12:02:35.769550 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Connection: close Oct 11 12:02:35.769550 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Length: 0 Oct 11 12:02:35.769550 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Type: application/json Oct 11 12:02:35.769550 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Host: 10.222.0.59 Oct 11 12:02:35.769550 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Openstack-System-Scope: None Oct 11 12:02:35.769550 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: User-Agent: python-urllib3/1.26.12 Oct 11 12:02:35.769550 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Auth-Token: gAAAAABjRVsij9q-JibmF83Gz45_QByFLPA8dDAC19AOY0c0oYH-ekbSxiLMI129JDu-r9RHIRpCY5CPD1vwSUR5kBvHx7xi4yXx9yZfndU2yXzjDtMusZKfwgaxnZ6kGIXkDJ-UvQw0_MDrsj_gmBBqbDAGPW9HFa0AMaZuninGObmHvSWpoi0 Oct 11 12:02:35.769550 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Id: None Oct 11 12:02:35.769550 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Name: None Oct 11 12:02:35.769550 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Identity-Status: Confirmed Oct 11 12:02:35.769550 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Is-Admin-Project: True Oct 11 12:02:35.769550 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Id: default Oct 11 12:02:35.769550 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Name: Default Oct 11 12:02:35.769550 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Id: f943e2a175344e40b29c72019ba95b03 Oct 11 12:02:35.769550 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Name: tempest-VolumesActionsTest-228528782 Oct 11 12:02:35.769550 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Role: reader,member Oct 11 12:02:35.769550 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Roles: reader,member Oct 11 12:02:35.771187 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f943e2a175344e40b29c72019ba95b03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f943e2a175344e40b29c72019ba95b03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f943e2a175344e40b29c72019ba95b03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f943e2a175344e40b29c72019ba95b03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:02:35.771187 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant: tempest-VolumesActionsTest-228528782 Oct 11 12:02:35.771187 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Id: f943e2a175344e40b29c72019ba95b03 Oct 11 12:02:35.771187 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Name: tempest-VolumesActionsTest-228528782 Oct 11 12:02:35.771187 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User: tempest-VolumesActionsTest-228528782-project Oct 11 12:02:35.771187 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Id: default Oct 11 12:02:35.771187 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Name: Default Oct 11 12:02:35.771187 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Id: ae372b81003e41aeb654da0bcca928d5 Oct 11 12:02:35.771187 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Name: tempest-VolumesActionsTest-228528782-project Oct 11 12:02:35.771187 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: method: > Oct 11 12:02:35.771187 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: exception: Instance 4f4546a4-8930-4f69-8f88-e4b23dc9d21c could not be found. Oct 11 12:02:35.771187 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: action_args: {'id': '4f4546a4-8930-4f69-8f88-e4b23dc9d21c'} Oct 11 12:02:35.772533 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:02:35.772533 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:02:35.772533 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:02:35.772533 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:02:35.772533 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:02:35.772533 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:02:35.772533 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:02:35.772533 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:02:35.772533 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:02:35.772533 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:02:35.772533 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4f4546a4-8930-4f69-8f88-e4b23dc9d21c could not be found. Oct 11 12:02:35.772533 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:02:35.772533 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:02:35.772533 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:02:35.772533 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:02:35.772533 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:02:35.772533 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:02:35.772533 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:02:35.772533 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:02:35.772533 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:02:35.776444 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:02:35.776444 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 12:02:35.776444 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 12:02:35.776444 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:02:35.776444 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:02:35.776444 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:02:35.776444 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:02:35.776444 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4f4546a4-8930-4f69-8f88-e4b23dc9d21c could not be found. Oct 11 12:02:35.776444 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:02:35.776444 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:02:35.776444 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:02:35.776444 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:02:35.776444 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:02:35.776444 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:02:35.776444 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:02:35.776444 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:02:35.776444 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4f4546a4-8930-4f69-8f88-e4b23dc9d21c could not be found. Oct 11 12:02:35.776444 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:02:35.780061 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-d357070e-04a6-45a9-92b7-3f780688d2b6 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Returning 404 to user: Instance 4f4546a4-8930-4f69-8f88-e4b23dc9d21c could not be found. {{(pid=118994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:02:35.780061 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-d357070e-04a6-45a9-92b7-3f780688d2b6 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c" status: 404 len: 111 microversion: 2.1 time: 0.038060 Oct 11 12:02:35.780061 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 156/321] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:35 2022] GET /compute/v2.1/servers/4f4546a4-8930-4f69-8f88-e4b23dc9d21c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:02:35.980979 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-2e3262fb-b466-4934-a2d4-a972f44afbb6 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-554236674", "imageRef": "09bcc8f8-a32f-4ec8-9ab2-a98964ad6a01", "flavorRef": "452", "networks": [{"uuid": "48fbb130-efad-44e2-81ce-c59f94ee5b96"}]}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:02:36.011531 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-77bc1a71-ddf5-4e2f-b367-5fd9ea03d32e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:36.027566 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-77bc1a71-ddf5-4e2f-b367-5fd9ea03d32e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1363 microversion: 2.1 time: 0.299492 Oct 11 12:02:36.028892 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 166/322] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:35 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1363 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:36.039091 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8df00b2c-ad2f-4d83-a866-13c9e296df55 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:36.040394 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8df00b2c-ad2f-4d83-a866-13c9e296df55 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:36.052497 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8df00b2c-ad2f-4d83-a866-13c9e296df55 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:36.053420 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8df00b2c-ad2f-4d83-a866-13c9e296df55 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:36.054244 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8df00b2c-ad2f-4d83-a866-13c9e296df55 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:36.055541 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8df00b2c-ad2f-4d83-a866-13c9e296df55 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:36.056382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8df00b2c-ad2f-4d83-a866-13c9e296df55 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:36.057193 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8df00b2c-ad2f-4d83-a866-13c9e296df55 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:36.074192 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.network.neutron [None req-2e3262fb-b466-4934-a2d4-a972f44afbb6 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] validate_networks() for [('48fbb130-efad-44e2-81ce-c59f94ee5b96', None, None, None, None, None)] {{(pid=118994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 12:02:36.311764 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8df00b2c-ad2f-4d83-a866-13c9e296df55 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:36.321692 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8df00b2c-ad2f-4d83-a866-13c9e296df55 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1502 microversion: 2.1 time: 0.291072 Oct 11 12:02:36.322355 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 167/323] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:36 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1502 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:36.364762 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-bcbc5881-c369-414c-be30-e5b3b8eb4c87 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ad80bc2-89fd-4a37-a7cb-48ae66cff8c3"}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:02:36.372765 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-bcbc5881-c369-414c-be30-e5b3b8eb4c87 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:36.396886 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bcbc5881-c369-414c-be30-e5b3b8eb4c87 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:36.399738 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bcbc5881-c369-414c-be30-e5b3b8eb4c87 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:36.400779 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bcbc5881-c369-414c-be30-e5b3b8eb4c87 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:36.409513 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bcbc5881-c369-414c-be30-e5b3b8eb4c87 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:36.410480 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bcbc5881-c369-414c-be30-e5b3b8eb4c87 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:36.416490 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bcbc5881-c369-414c-be30-e5b3b8eb4c87 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:36.423782 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=100 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:02:36.487329 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-bcbc5881-c369-414c-be30-e5b3b8eb4c87 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] HTTP exception thrown: Cannot 'attach_volume' instance a6da2ee3-f7c1-4cab-a6bd-096baa684fca while it is in vm_state rescued Oct 11 12:02:36.487329 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-bcbc5881-c369-414c-be30-e5b3b8eb4c87 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Request method failure captured: Oct 11 12:02:36.487329 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: request: POST /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca/os-volume_attachments HTTP/1.1 Oct 11 12:02:36.487329 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 11 12:02:36.487329 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 11 12:02:36.487329 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Connection: close Oct 11 12:02:36.487329 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Length: 74 Oct 11 12:02:36.487329 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 11 12:02:36.487329 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Host: 10.222.0.59 Oct 11 12:02:36.487329 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 11 12:02:36.487329 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 11 12:02:36.487329 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjRVrJaSzGAAsqN9YGFXD6DdIsLyt5xdpqMt74hKm0_jmhSi4ZXRo-fmMLSlB8g5keLfi_7ztQVJjqAgS19u6mD9NIFMQvvckksKoE6xupAQa0kDeitdjWA3oiAr9oO9Gi_CEanhcbJ1BGNm6XToopMs81aIIr4CbmeaUmYW-C9S4ctTo Oct 11 12:02:36.487329 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 11 12:02:36.487329 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 11 12:02:36.487329 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 11 12:02:36.487329 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 11 12:02:36.487329 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 11 12:02:36.487329 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 11 12:02:36.487329 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Id: e3e6a648f46646cea42b910d02e0628f Oct 11 12:02:36.487329 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-166493339 Oct 11 12:02:36.487329 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Role: reader,member Oct 11 12:02:36.487329 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Roles: reader,member Oct 11 12:02:36.489751 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e3e6a648f46646cea42b910d02e0628f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e3e6a648f46646cea42b910d02e0628f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e3e6a648f46646cea42b910d02e0628f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e3e6a648f46646cea42b910d02e0628f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:02:36.489751 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-ServerRescueNegativeTestJSON-166493339 Oct 11 12:02:36.489751 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Id: e3e6a648f46646cea42b910d02e0628f Oct 11 12:02:36.489751 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-166493339 Oct 11 12:02:36.489751 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User: tempest-ServerRescueNegativeTestJSON-166493339-project Oct 11 12:02:36.489751 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 11 12:02:36.489751 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 11 12:02:36.489751 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Id: c58107eee1b94541a330c26d7b82a53b Oct 11 12:02:36.489751 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-ServerRescueNegativeTestJSON-166493339-project Oct 11 12:02:36.489751 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Oct 11 12:02:36.489751 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {"volumeAttachment": {"volumeId": "1ad80bc2-89fd-4a37-a7cb-48ae66cff8c3"}} Oct 11 12:02:36.489751 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: method: > Oct 11 12:02:36.492314 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: exception: Cannot 'attach_volume' instance a6da2ee3-f7c1-4cab-a6bd-096baa684fca while it is in vm_state rescued Oct 11 12:02:36.492314 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: action_args: {'server_id': 'a6da2ee3-f7c1-4cab-a6bd-096baa684fca', 'body': {'volumeAttachment': {'volumeId': '1ad80bc2-89fd-4a37-a7cb-48ae66cff8c3'}}} Oct 11 12:02:36.492314 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:02:36.492314 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:02:36.492314 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 11 12:02:36.492314 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 11 12:02:36.492314 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 12:02:36.492314 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 12:02:36.492314 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 12:02:36.492314 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 12:02:36.492314 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a6da2ee3-f7c1-4cab-a6bd-096baa684fca in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 11 12:02:36.492314 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:02:36.492314 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:02:36.492314 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:02:36.492314 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:02:36.492314 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:02:36.492314 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:02:36.492314 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:02:36.492314 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:02:36.499774 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:02:36.499774 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:02:36.499774 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 12:02:36.499774 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 12:02:36.499774 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 12:02:36.499774 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 12:02:36.499774 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 12:02:36.499774 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 12:02:36.499774 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 11 12:02:36.499774 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 12:02:36.499774 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 12:02:36.499774 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 12:02:36.499774 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance a6da2ee3-f7c1-4cab-a6bd-096baa684fca while it is in vm_state rescued Oct 11 12:02:36.499774 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:02:36.499774 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:02:36.499774 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:02:36.499774 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:02:36.499774 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:02:36.499774 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:02:36.503747 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:02:36.503747 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:02:36.503747 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance a6da2ee3-f7c1-4cab-a6bd-096baa684fca while it is in vm_state rescued Oct 11 12:02:36.503747 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:02:36.503747 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-bcbc5881-c369-414c-be30-e5b3b8eb4c87 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Returning 409 to user: Cannot 'attach_volume' instance a6da2ee3-f7c1-4cab-a6bd-096baa684fca while it is in vm_state rescued {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:02:36.503747 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-bcbc5881-c369-414c-be30-e5b3b8eb4c87 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "POST /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.142290 Oct 11 12:02:36.503747 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 168/324] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Oct 11 12:02:36 2022] POST /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca/os-volume_attachments => generated 152 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 12:02:36.503747 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b7f60f7f-98b3-4395-a5f2-335086bd2d9b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:02:36.505534 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-b7f60f7f-98b3-4395-a5f2-335086bd2d9b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:36.517580 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b7f60f7f-98b3-4395-a5f2-335086bd2d9b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:36.518224 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b7f60f7f-98b3-4395-a5f2-335086bd2d9b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:36.518744 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b7f60f7f-98b3-4395-a5f2-335086bd2d9b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:36.519484 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b7f60f7f-98b3-4395-a5f2-335086bd2d9b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:36.519950 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b7f60f7f-98b3-4395-a5f2-335086bd2d9b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:36.520396 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b7f60f7f-98b3-4395-a5f2-335086bd2d9b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:36.642498 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b7f60f7f-98b3-4395-a5f2-335086bd2d9b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "POST /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca/action" status: 202 len: 0 microversion: 2.1 time: 0.148508 Oct 11 12:02:36.643234 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 169/325] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Oct 11 12:02:36 2022] POST /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca/action => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 12:02:36.657173 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2dda6031-7d19-4a01-b2d3-6778fa863608 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:36.658643 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2dda6031-7d19-4a01-b2d3-6778fa863608 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:36.668469 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-2e3262fb-b466-4934-a2d4-a972f44afbb6 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Flavor limits 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 12:02:36.670134 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-2e3262fb-b466-4934-a2d4-a972f44afbb6 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Image limits 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 12:02:36.670412 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2dda6031-7d19-4a01-b2d3-6778fa863608 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:36.671301 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2dda6031-7d19-4a01-b2d3-6778fa863608 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:36.672105 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2dda6031-7d19-4a01-b2d3-6778fa863608 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:36.672382 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-2e3262fb-b466-4934-a2d4-a972f44afbb6 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Flavor pref 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 12:02:36.673007 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-2e3262fb-b466-4934-a2d4-a972f44afbb6 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Image pref 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 12:02:36.673450 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2dda6031-7d19-4a01-b2d3-6778fa863608 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:36.673553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-2e3262fb-b466-4934-a2d4-a972f44afbb6 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 12:02:36.674278 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2dda6031-7d19-4a01-b2d3-6778fa863608 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:36.675273 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2dda6031-7d19-4a01-b2d3-6778fa863608 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:36.684089 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2e3262fb-b466-4934-a2d4-a972f44afbb6 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:36.684885 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2e3262fb-b466-4934-a2d4-a972f44afbb6 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:36.685385 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2e3262fb-b466-4934-a2d4-a972f44afbb6 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:36.686402 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2e3262fb-b466-4934-a2d4-a972f44afbb6 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:36.686924 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2e3262fb-b466-4934-a2d4-a972f44afbb6 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:36.687347 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2e3262fb-b466-4934-a2d4-a972f44afbb6 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:36.708385 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-2e3262fb-b466-4934-a2d4-a972f44afbb6 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Getting quotas for project f943e2a175344e40b29c72019ba95b03. Resources: {'ram', 'instances', 'cores'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 12:02:36.713471 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-2e3262fb-b466-4934-a2d4-a972f44afbb6 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Getting quotas for user ae372b81003e41aeb654da0bcca928d5 and project f943e2a175344e40b29c72019ba95b03. Resources: {'ram', 'instances', 'cores'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 12:02:36.727491 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-2e3262fb-b466-4934-a2d4-a972f44afbb6 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Going to run 1 instances... {{(pid=118994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 12:02:36.730133 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-2e3262fb-b466-4934-a2d4-a972f44afbb6 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: f2670172-9447-488d-bce1-28f4715a7d5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09bcc8f8-a32f-4ec8-9ab2-a98964ad6a01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 12:02:36.802375 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-2e3262fb-b466-4934-a2d4-a972f44afbb6 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.838767 Oct 11 12:02:36.803558 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 157/326] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Oct 11 12:02:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 12:02:36.822186 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-57043042-b6cd-4db1-a225-f34d61ec1d23 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:36.823113 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-57043042-b6cd-4db1-a225-f34d61ec1d23 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: f2670172-9447-488d-bce1-28f4715a7d5e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:36.912922 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-57043042-b6cd-4db1-a225-f34d61ec1d23 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:36.930103 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-57043042-b6cd-4db1-a225-f34d61ec1d23 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e" status: 200 len: 1213 microversion: 2.1 time: 0.113188 Oct 11 12:02:36.931130 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 158/327] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:36 2022] GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e => generated 1213 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:36.978094 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2dda6031-7d19-4a01-b2d3-6778fa863608 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:36.996606 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2dda6031-7d19-4a01-b2d3-6778fa863608 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1510 microversion: 2.1 time: 0.347644 Oct 11 12:02:36.997641 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 170/328] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:36 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1510 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:02:37.052538 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-15a08ec6-d77d-4df5-851e-9c7a44cb91d5 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:37.053171 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-15a08ec6-d77d-4df5-851e-9c7a44cb91d5 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:37.059661 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-15a08ec6-d77d-4df5-851e-9c7a44cb91d5 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:37.060227 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-15a08ec6-d77d-4df5-851e-9c7a44cb91d5 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:37.061142 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-15a08ec6-d77d-4df5-851e-9c7a44cb91d5 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:37.062497 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-15a08ec6-d77d-4df5-851e-9c7a44cb91d5 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:37.063536 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-15a08ec6-d77d-4df5-851e-9c7a44cb91d5 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:37.064138 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-15a08ec6-d77d-4df5-851e-9c7a44cb91d5 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:37.276612 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-15a08ec6-d77d-4df5-851e-9c7a44cb91d5 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:37.292142 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-15a08ec6-d77d-4df5-851e-9c7a44cb91d5 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1363 microversion: 2.1 time: 0.243407 Oct 11 12:02:37.293148 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 159/329] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:37 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:37.976515 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7ac36ab6-0aa0-4955-97e3-475fb9a2360f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:37.977587 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7ac36ab6-0aa0-4955-97e3-475fb9a2360f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: f2670172-9447-488d-bce1-28f4715a7d5e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:37.989364 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7ac36ab6-0aa0-4955-97e3-475fb9a2360f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:37.990253 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7ac36ab6-0aa0-4955-97e3-475fb9a2360f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:37.991061 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7ac36ab6-0aa0-4955-97e3-475fb9a2360f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:37.992315 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7ac36ab6-0aa0-4955-97e3-475fb9a2360f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:37.993125 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7ac36ab6-0aa0-4955-97e3-475fb9a2360f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:37.993825 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7ac36ab6-0aa0-4955-97e3-475fb9a2360f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:38.029838 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-74e32160-4824-4358-82df-8533f747c92e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:38.030913 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-74e32160-4824-4358-82df-8533f747c92e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:38.037727 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-74e32160-4824-4358-82df-8533f747c92e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:38.038427 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-74e32160-4824-4358-82df-8533f747c92e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:38.039113 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-74e32160-4824-4358-82df-8533f747c92e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:38.040044 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-74e32160-4824-4358-82df-8533f747c92e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:38.040502 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-74e32160-4824-4358-82df-8533f747c92e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:38.040923 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-74e32160-4824-4358-82df-8533f747c92e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:38.141091 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7ac36ab6-0aa0-4955-97e3-475fb9a2360f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:38.179891 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7ac36ab6-0aa0-4955-97e3-475fb9a2360f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e" status: 200 len: 1209 microversion: 2.1 time: 0.210657 Oct 11 12:02:38.181692 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 171/330] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:37 2022] GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e => generated 1209 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:38.261385 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-74e32160-4824-4358-82df-8533f747c92e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:38.271567 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-74e32160-4824-4358-82df-8533f747c92e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1510 microversion: 2.1 time: 0.246268 Oct 11 12:02:38.272326 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 160/331] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:38 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1510 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:02:38.334355 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-49a2e06b-bbfc-464f-808d-2a5b4576c405 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:38.335130 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-49a2e06b-bbfc-464f-808d-2a5b4576c405 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:38.342413 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-49a2e06b-bbfc-464f-808d-2a5b4576c405 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:38.342938 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-49a2e06b-bbfc-464f-808d-2a5b4576c405 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:38.343653 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-49a2e06b-bbfc-464f-808d-2a5b4576c405 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:38.344444 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-49a2e06b-bbfc-464f-808d-2a5b4576c405 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:38.344935 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-49a2e06b-bbfc-464f-808d-2a5b4576c405 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:38.345360 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-49a2e06b-bbfc-464f-808d-2a5b4576c405 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:38.591093 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-49a2e06b-bbfc-464f-808d-2a5b4576c405 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:38.605028 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-49a2e06b-bbfc-464f-808d-2a5b4576c405 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1363 microversion: 2.1 time: 0.274624 Oct 11 12:02:38.605911 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 172/332] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:38 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1363 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:02:39.217351 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-064877d1-e07f-42fc-9bdf-7050c30bf87f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:39.218471 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-064877d1-e07f-42fc-9bdf-7050c30bf87f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: f2670172-9447-488d-bce1-28f4715a7d5e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:39.232371 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-064877d1-e07f-42fc-9bdf-7050c30bf87f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:39.234239 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-064877d1-e07f-42fc-9bdf-7050c30bf87f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:39.235003 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-064877d1-e07f-42fc-9bdf-7050c30bf87f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:39.235986 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-064877d1-e07f-42fc-9bdf-7050c30bf87f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:39.238810 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-064877d1-e07f-42fc-9bdf-7050c30bf87f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:39.240610 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-064877d1-e07f-42fc-9bdf-7050c30bf87f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:39.306966 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-669064b6-b46d-47b9-a803-2d5a91a33400 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:39.311534 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-669064b6-b46d-47b9-a803-2d5a91a33400 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:39.330142 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=94 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:02:39.336807 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-669064b6-b46d-47b9-a803-2d5a91a33400 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:39.337619 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-669064b6-b46d-47b9-a803-2d5a91a33400 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:39.339185 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-669064b6-b46d-47b9-a803-2d5a91a33400 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:39.340874 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-669064b6-b46d-47b9-a803-2d5a91a33400 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:39.341691 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-669064b6-b46d-47b9-a803-2d5a91a33400 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:39.343587 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-669064b6-b46d-47b9-a803-2d5a91a33400 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:39.368853 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-064877d1-e07f-42fc-9bdf-7050c30bf87f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:39.389643 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-064877d1-e07f-42fc-9bdf-7050c30bf87f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e" status: 200 len: 1265 microversion: 2.1 time: 0.176015 Oct 11 12:02:39.402312 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 161/333] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:39 2022] GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:39.637052 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-0af4dc0e-a8ec-497e-b204-d90327241127 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:39.637719 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-0af4dc0e-a8ec-497e-b204-d90327241127 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:39.659056 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0af4dc0e-a8ec-497e-b204-d90327241127 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:39.659541 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0af4dc0e-a8ec-497e-b204-d90327241127 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:39.672360 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0af4dc0e-a8ec-497e-b204-d90327241127 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:39.673544 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0af4dc0e-a8ec-497e-b204-d90327241127 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:39.674384 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0af4dc0e-a8ec-497e-b204-d90327241127 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:39.675024 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-669064b6-b46d-47b9-a803-2d5a91a33400 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:39.675471 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0af4dc0e-a8ec-497e-b204-d90327241127 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:39.692487 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-669064b6-b46d-47b9-a803-2d5a91a33400 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1510 microversion: 2.1 time: 0.399013 Oct 11 12:02:39.710154 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 173/334] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:39 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1510 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:02:40.073337 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-0af4dc0e-a8ec-497e-b204-d90327241127 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:40.087861 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-0af4dc0e-a8ec-497e-b204-d90327241127 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1549 microversion: 2.1 time: 0.454623 Oct 11 12:02:40.088969 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 162/335] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:39 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1549 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:40.134768 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9697d162-dbca-4d9b-8fe1-27f5a8ed189b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:40.135570 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9697d162-dbca-4d9b-8fe1-27f5a8ed189b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:40.148880 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9697d162-dbca-4d9b-8fe1-27f5a8ed189b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:40.149830 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9697d162-dbca-4d9b-8fe1-27f5a8ed189b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:40.151551 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9697d162-dbca-4d9b-8fe1-27f5a8ed189b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:40.153228 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9697d162-dbca-4d9b-8fe1-27f5a8ed189b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:40.154374 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9697d162-dbca-4d9b-8fe1-27f5a8ed189b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:40.155209 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9697d162-dbca-4d9b-8fe1-27f5a8ed189b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:40.397103 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9697d162-dbca-4d9b-8fe1-27f5a8ed189b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.272624 Oct 11 12:02:40.407718 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 174/336] 10.222.0.59 () {58 vars in 1275 bytes} [Tue Oct 11 12:02:40 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91/os-interface => generated 284 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:02:40.432745 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-3ea35dc5-bccc-46ca-b0ad-b4240ee58cfb tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:40.434064 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-3ea35dc5-bccc-46ca-b0ad-b4240ee58cfb tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: f2670172-9447-488d-bce1-28f4715a7d5e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:40.449549 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3ea35dc5-bccc-46ca-b0ad-b4240ee58cfb tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:40.451066 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3ea35dc5-bccc-46ca-b0ad-b4240ee58cfb tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:40.453182 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3ea35dc5-bccc-46ca-b0ad-b4240ee58cfb tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:40.455025 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3ea35dc5-bccc-46ca-b0ad-b4240ee58cfb tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:40.455821 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3ea35dc5-bccc-46ca-b0ad-b4240ee58cfb tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:40.457657 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3ea35dc5-bccc-46ca-b0ad-b4240ee58cfb tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:40.598608 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-3ea35dc5-bccc-46ca-b0ad-b4240ee58cfb tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:40.622472 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-3ea35dc5-bccc-46ca-b0ad-b4240ee58cfb tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e" status: 200 len: 1271 microversion: 2.1 time: 0.195723 Oct 11 12:02:40.623569 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 163/337] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:40 2022] GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e => generated 1271 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:40.733252 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9618e01e-02a6-4c19-9735-66b337b5d3da tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:40.735035 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9618e01e-02a6-4c19-9735-66b337b5d3da tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:40.757405 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9618e01e-02a6-4c19-9735-66b337b5d3da tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:40.758858 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9618e01e-02a6-4c19-9735-66b337b5d3da tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:40.758858 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9618e01e-02a6-4c19-9735-66b337b5d3da tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:40.759947 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9618e01e-02a6-4c19-9735-66b337b5d3da tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:40.764349 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9618e01e-02a6-4c19-9735-66b337b5d3da tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:40.765058 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9618e01e-02a6-4c19-9735-66b337b5d3da tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:41.261918 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-9618e01e-02a6-4c19-9735-66b337b5d3da tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:41.271111 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9618e01e-02a6-4c19-9735-66b337b5d3da tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1510 microversion: 2.1 time: 0.556295 Oct 11 12:02:41.289895 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 175/338] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:40 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1510 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:41.660986 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-2fd64821-9253-4523-925a-a1ee675db67c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:41.661956 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-2fd64821-9253-4523-925a-a1ee675db67c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: f2670172-9447-488d-bce1-28f4715a7d5e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:41.669858 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2fd64821-9253-4523-925a-a1ee675db67c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:41.670350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2fd64821-9253-4523-925a-a1ee675db67c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:41.670825 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2fd64821-9253-4523-925a-a1ee675db67c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:41.671568 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2fd64821-9253-4523-925a-a1ee675db67c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:41.672029 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2fd64821-9253-4523-925a-a1ee675db67c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:41.672446 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2fd64821-9253-4523-925a-a1ee675db67c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:41.914864 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-2fd64821-9253-4523-925a-a1ee675db67c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:41.940786 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-2fd64821-9253-4523-925a-a1ee675db67c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e" status: 200 len: 1313 microversion: 2.1 time: 0.283292 Oct 11 12:02:41.942367 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 164/339] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:41 2022] GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e => generated 1313 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:42.306504 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-1710fd05-e7ec-4fba-a2f6-64a29af92dde tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:42.309469 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-1710fd05-e7ec-4fba-a2f6-64a29af92dde tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:42.322970 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1710fd05-e7ec-4fba-a2f6-64a29af92dde tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:42.324396 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1710fd05-e7ec-4fba-a2f6-64a29af92dde tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:42.325471 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1710fd05-e7ec-4fba-a2f6-64a29af92dde tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:42.326938 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1710fd05-e7ec-4fba-a2f6-64a29af92dde tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:42.327667 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1710fd05-e7ec-4fba-a2f6-64a29af92dde tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:42.328601 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1710fd05-e7ec-4fba-a2f6-64a29af92dde tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:42.711696 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-1710fd05-e7ec-4fba-a2f6-64a29af92dde tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:42.726628 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-1710fd05-e7ec-4fba-a2f6-64a29af92dde tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1510 microversion: 2.1 time: 0.429420 Oct 11 12:02:42.743257 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 176/340] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:42 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1510 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:02:42.992413 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-192d05f6-c45c-4989-9759-b23190d55fc0 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:42.993156 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-192d05f6-c45c-4989-9759-b23190d55fc0 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: f2670172-9447-488d-bce1-28f4715a7d5e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:43.003260 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-192d05f6-c45c-4989-9759-b23190d55fc0 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:43.003260 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-192d05f6-c45c-4989-9759-b23190d55fc0 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:43.003929 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-192d05f6-c45c-4989-9759-b23190d55fc0 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:43.004927 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-192d05f6-c45c-4989-9759-b23190d55fc0 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:43.005486 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-192d05f6-c45c-4989-9759-b23190d55fc0 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:43.007017 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-192d05f6-c45c-4989-9759-b23190d55fc0 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:43.085760 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-1fde8d97-851f-4498-ab13-0d0c17743929 req-bc2b9e41-b649-4289-b11a-dd85e04b7479 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3277e26-d502-49fd-ba21-b427effd9d91", "tag": "8addee64-ef1f-4a6a-8f09-b378e453cff5"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:02:43.097593 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-1fde8d97-851f-4498-ab13-0d0c17743929 req-bc2b9e41-b649-4289-b11a-dd85e04b7479 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:43.098069 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-1fde8d97-851f-4498-ab13-0d0c17743929 req-bc2b9e41-b649-4289-b11a-dd85e04b7479 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:43.098503 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-1fde8d97-851f-4498-ab13-0d0c17743929 req-bc2b9e41-b649-4289-b11a-dd85e04b7479 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:43.111105 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-1fde8d97-851f-4498-ab13-0d0c17743929 req-bc2b9e41-b649-4289-b11a-dd85e04b7479 service nova] Creating event network-changed:8addee64-ef1f-4a6a-8f09-b378e453cff5 for instance e3277e26-d502-49fd-ba21-b427effd9d91 on hv-cinder-82099 Oct 11 12:02:43.131685 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-1fde8d97-851f-4498-ab13-0d0c17743929 req-bc2b9e41-b649-4289-b11a-dd85e04b7479 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051029 Oct 11 12:02:43.132296 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 177/341] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:02:43.197603 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-192d05f6-c45c-4989-9759-b23190d55fc0 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:43.206402 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-192d05f6-c45c-4989-9759-b23190d55fc0 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e" status: 200 len: 1313 microversion: 2.1 time: 0.220756 Oct 11 12:02:43.207300 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 165/342] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:42 2022] GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:02:43.754076 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5a1b8531-2d9e-45e2-86c2-b26c23394cce tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:43.755801 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-5a1b8531-2d9e-45e2-86c2-b26c23394cce tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:43.762889 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5a1b8531-2d9e-45e2-86c2-b26c23394cce tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:43.763416 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5a1b8531-2d9e-45e2-86c2-b26c23394cce tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:43.763840 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5a1b8531-2d9e-45e2-86c2-b26c23394cce tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:43.764563 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5a1b8531-2d9e-45e2-86c2-b26c23394cce tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:43.765011 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5a1b8531-2d9e-45e2-86c2-b26c23394cce tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:43.765419 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5a1b8531-2d9e-45e2-86c2-b26c23394cce tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:43.942929 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5a1b8531-2d9e-45e2-86c2-b26c23394cce tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:43.959893 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5a1b8531-2d9e-45e2-86c2-b26c23394cce tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1510 microversion: 2.1 time: 0.212126 Oct 11 12:02:43.961325 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 178/343] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:43 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1510 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:44.229756 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-419196ed-d0e5-4a75-98bd-e057d0dbe887 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:44.231069 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-419196ed-d0e5-4a75-98bd-e057d0dbe887 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: f2670172-9447-488d-bce1-28f4715a7d5e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:44.242151 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-419196ed-d0e5-4a75-98bd-e057d0dbe887 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:44.242675 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-419196ed-d0e5-4a75-98bd-e057d0dbe887 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:44.243091 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-419196ed-d0e5-4a75-98bd-e057d0dbe887 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:44.243782 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-419196ed-d0e5-4a75-98bd-e057d0dbe887 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:44.244217 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-419196ed-d0e5-4a75-98bd-e057d0dbe887 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:44.244631 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-419196ed-d0e5-4a75-98bd-e057d0dbe887 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:44.413988 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-419196ed-d0e5-4a75-98bd-e057d0dbe887 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:44.422903 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-419196ed-d0e5-4a75-98bd-e057d0dbe887 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e" status: 200 len: 1313 microversion: 2.1 time: 0.196947 Oct 11 12:02:44.423705 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 166/344] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:44 2022] GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:44.985350 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-80d79da6-568b-4e18-b99a-841f169b8c2b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:44.986541 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-80d79da6-568b-4e18-b99a-841f169b8c2b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:44.997974 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-80d79da6-568b-4e18-b99a-841f169b8c2b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:44.999244 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-80d79da6-568b-4e18-b99a-841f169b8c2b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:44.999959 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-80d79da6-568b-4e18-b99a-841f169b8c2b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:45.001346 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-80d79da6-568b-4e18-b99a-841f169b8c2b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:45.008946 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-80d79da6-568b-4e18-b99a-841f169b8c2b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:45.009558 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-80d79da6-568b-4e18-b99a-841f169b8c2b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:45.172085 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-d0dd040b-4fd6-4856-a147-111a5d8d43bd req-b9b1c395-fffe-44f4-89ac-529b2e8993b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2670172-9447-488d-bce1-28f4715a7d5e", "tag": "912cb6c1-febe-45d0-8b36-1145aa78eae6"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:02:45.180400 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-80d79da6-568b-4e18-b99a-841f169b8c2b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:45.182396 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-d0dd040b-4fd6-4856-a147-111a5d8d43bd req-b9b1c395-fffe-44f4-89ac-529b2e8993b3 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:45.182895 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-d0dd040b-4fd6-4856-a147-111a5d8d43bd req-b9b1c395-fffe-44f4-89ac-529b2e8993b3 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:45.183343 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-d0dd040b-4fd6-4856-a147-111a5d8d43bd req-b9b1c395-fffe-44f4-89ac-529b2e8993b3 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:45.190124 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-80d79da6-568b-4e18-b99a-841f169b8c2b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1510 microversion: 2.1 time: 0.209302 Oct 11 12:02:45.202925 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 179/345] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:44 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1510 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:45.207506 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-d0dd040b-4fd6-4856-a147-111a5d8d43bd req-b9b1c395-fffe-44f4-89ac-529b2e8993b3 service nova] Creating event network-changed:912cb6c1-febe-45d0-8b36-1145aa78eae6 for instance f2670172-9447-488d-bce1-28f4715a7d5e on hv-cinder-82099 Oct 11 12:02:45.212792 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-d0dd040b-4fd6-4856-a147-111a5d8d43bd req-b9b1c395-fffe-44f4-89ac-529b2e8993b3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045675 Oct 11 12:02:45.213394 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 167/346] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:02:45.447102 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-06fc05e9-0e68-4e9d-adc9-82e670c3a1f4 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:45.448776 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-06fc05e9-0e68-4e9d-adc9-82e670c3a1f4 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: f2670172-9447-488d-bce1-28f4715a7d5e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:45.460042 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06fc05e9-0e68-4e9d-adc9-82e670c3a1f4 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:45.460925 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06fc05e9-0e68-4e9d-adc9-82e670c3a1f4 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:45.461838 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06fc05e9-0e68-4e9d-adc9-82e670c3a1f4 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:45.463380 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06fc05e9-0e68-4e9d-adc9-82e670c3a1f4 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:45.464276 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06fc05e9-0e68-4e9d-adc9-82e670c3a1f4 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:45.465050 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06fc05e9-0e68-4e9d-adc9-82e670c3a1f4 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:45.691140 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-06fc05e9-0e68-4e9d-adc9-82e670c3a1f4 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:45.703154 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-06fc05e9-0e68-4e9d-adc9-82e670c3a1f4 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e" status: 200 len: 1313 microversion: 2.1 time: 0.261119 Oct 11 12:02:45.704323 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 180/347] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:45 2022] GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e => generated 1313 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:46.216575 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-4254ea04-655c-4a8e-9206-9a8efc99047e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:46.217531 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-4254ea04-655c-4a8e-9206-9a8efc99047e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:46.224602 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4254ea04-655c-4a8e-9206-9a8efc99047e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:46.225315 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4254ea04-655c-4a8e-9206-9a8efc99047e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:46.225528 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4254ea04-655c-4a8e-9206-9a8efc99047e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:46.226260 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4254ea04-655c-4a8e-9206-9a8efc99047e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:46.226730 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4254ea04-655c-4a8e-9206-9a8efc99047e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:46.227123 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4254ea04-655c-4a8e-9206-9a8efc99047e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:46.393181 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-4254ea04-655c-4a8e-9206-9a8efc99047e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:46.407546 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-4254ea04-655c-4a8e-9206-9a8efc99047e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1516 microversion: 2.1 time: 0.195354 Oct 11 12:02:46.411019 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 168/348] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:46 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1516 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:46.733966 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-234d8b7a-c909-455e-b83b-3c14a4510183 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:46.734834 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-234d8b7a-c909-455e-b83b-3c14a4510183 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: f2670172-9447-488d-bce1-28f4715a7d5e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:46.744226 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-234d8b7a-c909-455e-b83b-3c14a4510183 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:46.745664 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-234d8b7a-c909-455e-b83b-3c14a4510183 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:46.746440 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-234d8b7a-c909-455e-b83b-3c14a4510183 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:46.748249 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-234d8b7a-c909-455e-b83b-3c14a4510183 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:46.748957 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-234d8b7a-c909-455e-b83b-3c14a4510183 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:46.749662 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-234d8b7a-c909-455e-b83b-3c14a4510183 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:47.076219 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-234d8b7a-c909-455e-b83b-3c14a4510183 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:47.085022 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-234d8b7a-c909-455e-b83b-3c14a4510183 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e" status: 200 len: 1313 microversion: 2.1 time: 0.360475 Oct 11 12:02:47.085751 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 181/349] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:46 2022] GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e => generated 1313 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:47.954637 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-d713e1d2-6d18-48e5-9b72-51dc8561419f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Action: 'create', calling method: .version_select at 0x7fd4068b3310>, body: {"keypair": {"name": "tempest-keypair-594661262", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNgOfabizcbiJF81XmMF3cWdA897Lb6QXV8I7IirYG2YuegsHCU2BXEdwe4b/PRJcb7i5GijIn3NVNmT3EFrXanPQER8PktAWXjFQesXNZKPrgZgB6Xyj8G/E3QNVTY/Hw=="}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:02:47.961163 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell0:SELECT=2 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:02:47.962268 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell0:SELECT=8 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:02:47.987610 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-d713e1d2-6d18-48e5-9b72-51dc8561419f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Getting quotas for project e3e6a648f46646cea42b910d02e0628f. Resources: {'key_pairs'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 12:02:47.992515 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-d713e1d2-6d18-48e5-9b72-51dc8561419f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Getting quotas for user c58107eee1b94541a330c26d7b82a53b and project e3e6a648f46646cea42b910d02e0628f. Resources: {'key_pairs'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 12:02:48.023042 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-d713e1d2-6d18-48e5-9b72-51dc8561419f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.073032 Oct 11 12:02:48.023646 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 169/350] 10.222.0.59 () {60 vars in 1159 bytes} [Tue Oct 11 12:02:47 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 12:02:48.112979 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d424bc90-96ec-4c54-8bc7-be576a931358 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:48.113766 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d424bc90-96ec-4c54-8bc7-be576a931358 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: f2670172-9447-488d-bce1-28f4715a7d5e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:48.120884 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d424bc90-96ec-4c54-8bc7-be576a931358 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:48.121903 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d424bc90-96ec-4c54-8bc7-be576a931358 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:48.122546 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d424bc90-96ec-4c54-8bc7-be576a931358 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:48.124090 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d424bc90-96ec-4c54-8bc7-be576a931358 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:48.124090 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d424bc90-96ec-4c54-8bc7-be576a931358 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:48.124346 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d424bc90-96ec-4c54-8bc7-be576a931358 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:48.287474 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d424bc90-96ec-4c54-8bc7-be576a931358 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:48.296996 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d424bc90-96ec-4c54-8bc7-be576a931358 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e" status: 200 len: 1313 microversion: 2.1 time: 0.189223 Oct 11 12:02:48.313042 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 182/351] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:48 2022] GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e => generated 1313 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:49.320475 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-8834273c-9f9b-423c-953c-3b912cc5f3b7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:49.321065 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-8834273c-9f9b-423c-953c-3b912cc5f3b7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: f2670172-9447-488d-bce1-28f4715a7d5e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:49.327941 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8834273c-9f9b-423c-953c-3b912cc5f3b7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:49.328460 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8834273c-9f9b-423c-953c-3b912cc5f3b7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:49.328900 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8834273c-9f9b-423c-953c-3b912cc5f3b7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:49.329647 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8834273c-9f9b-423c-953c-3b912cc5f3b7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:49.330097 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8834273c-9f9b-423c-953c-3b912cc5f3b7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:49.330513 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8834273c-9f9b-423c-953c-3b912cc5f3b7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:49.443425 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2b1d4e16-ddeb-4440-b751-14e3ce4f35e8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1816934478", "imageRef": "09bcc8f8-a32f-4ec8-9ab2-a98964ad6a01", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "12e948e6-0dda-4a26-9a91-d284707ceba8"}], "security_groups": [{"name": "tempest-securitygroup--1642074374"}], "key_name": "tempest-keypair-594661262", "user_data": "}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:02:49.472621 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-8834273c-9f9b-423c-953c-3b912cc5f3b7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:49.482691 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-8834273c-9f9b-423c-953c-3b912cc5f3b7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e" status: 200 len: 1313 microversion: 2.1 time: 0.165468 Oct 11 12:02:49.482893 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 170/352] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:49 2022] GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:49.564368 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.network.neutron [None req-2b1d4e16-ddeb-4440-b751-14e3ce4f35e8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] validate_networks() for [('12e948e6-0dda-4a26-9a91-d284707ceba8', None, None, None, None, None)] {{(pid=118995) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 12:02:49.987620 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-2b1d4e16-ddeb-4440-b751-14e3ce4f35e8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Flavor limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 12:02:49.988186 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-2b1d4e16-ddeb-4440-b751-14e3ce4f35e8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Image limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 12:02:49.988657 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-2b1d4e16-ddeb-4440-b751-14e3ce4f35e8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Flavor pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 12:02:49.989072 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-2b1d4e16-ddeb-4440-b751-14e3ce4f35e8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Image pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 12:02:49.989820 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-2b1d4e16-ddeb-4440-b751-14e3ce4f35e8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 12:02:49.999511 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2b1d4e16-ddeb-4440-b751-14e3ce4f35e8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:50.000025 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2b1d4e16-ddeb-4440-b751-14e3ce4f35e8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:50.000470 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2b1d4e16-ddeb-4440-b751-14e3ce4f35e8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:50.001207 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2b1d4e16-ddeb-4440-b751-14e3ce4f35e8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:50.001687 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2b1d4e16-ddeb-4440-b751-14e3ce4f35e8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:50.002147 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2b1d4e16-ddeb-4440-b751-14e3ce4f35e8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:50.022833 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-2b1d4e16-ddeb-4440-b751-14e3ce4f35e8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Getting quotas for project e3e6a648f46646cea42b910d02e0628f. Resources: {'ram', 'instances', 'cores'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 12:02:50.027802 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-2b1d4e16-ddeb-4440-b751-14e3ce4f35e8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Getting quotas for user c58107eee1b94541a330c26d7b82a53b and project e3e6a648f46646cea42b910d02e0628f. Resources: {'ram', 'instances', 'cores'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 12:02:50.040874 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2b1d4e16-ddeb-4440-b751-14e3ce4f35e8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Going to run 1 instances... {{(pid=118995) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 12:02:50.043396 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2b1d4e16-ddeb-4440-b751-14e3ce4f35e8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09bcc8f8-a32f-4ec8-9ab2-a98964ad6a01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118995) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 12:02:50.094660 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2b1d4e16-ddeb-4440-b751-14e3ce4f35e8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.655936 Oct 11 12:02:50.095672 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 183/353] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Oct 11 12:02:49 2022] POST /compute/v2.1/servers => generated 409 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 12:02:50.107224 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-70593c4c-53c3-4c40-8e03-ba4c0734c8b9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:50.107902 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-70593c4c-53c3-4c40-8e03-ba4c0734c8b9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:50.163650 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-70593c4c-53c3-4c40-8e03-ba4c0734c8b9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:50.172743 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-70593c4c-53c3-4c40-8e03-ba4c0734c8b9 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1245 microversion: 2.1 time: 0.069407 Oct 11 12:02:50.174047 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 171/354] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:50 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1245 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:02:50.507868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-410af666-17a6-4baa-b211-c31dbc75580e tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:50.508652 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-410af666-17a6-4baa-b211-c31dbc75580e tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: f2670172-9447-488d-bce1-28f4715a7d5e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:50.536068 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-410af666-17a6-4baa-b211-c31dbc75580e tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:50.536922 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-410af666-17a6-4baa-b211-c31dbc75580e tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:50.537693 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-410af666-17a6-4baa-b211-c31dbc75580e tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:50.539005 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-410af666-17a6-4baa-b211-c31dbc75580e tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:50.540058 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-410af666-17a6-4baa-b211-c31dbc75580e tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:50.540832 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-410af666-17a6-4baa-b211-c31dbc75580e tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:50.776801 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-410af666-17a6-4baa-b211-c31dbc75580e tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:50.788629 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-410af666-17a6-4baa-b211-c31dbc75580e tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e" status: 200 len: 1313 microversion: 2.1 time: 0.286266 Oct 11 12:02:50.790102 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 184/355] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:50 2022] GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e => generated 1313 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:02:51.197622 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-34f60c9c-e6fc-4280-90d1-882586301333 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:51.199102 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-34f60c9c-e6fc-4280-90d1-882586301333 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:51.205460 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-34f60c9c-e6fc-4280-90d1-882586301333 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:51.205949 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-34f60c9c-e6fc-4280-90d1-882586301333 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:51.206378 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-34f60c9c-e6fc-4280-90d1-882586301333 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:51.207475 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-34f60c9c-e6fc-4280-90d1-882586301333 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:51.207935 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-34f60c9c-e6fc-4280-90d1-882586301333 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:51.208350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-34f60c9c-e6fc-4280-90d1-882586301333 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:51.276292 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-34f60c9c-e6fc-4280-90d1-882586301333 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:51.284918 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-34f60c9c-e6fc-4280-90d1-882586301333 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1297 microversion: 2.1 time: 0.091995 Oct 11 12:02:51.285555 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 172/356] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:51 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1297 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:51.815096 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b42359cf-472f-47b9-bcd3-d74811ac779f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:51.815920 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-b42359cf-472f-47b9-bcd3-d74811ac779f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: f2670172-9447-488d-bce1-28f4715a7d5e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:51.824131 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b42359cf-472f-47b9-bcd3-d74811ac779f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:51.824897 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b42359cf-472f-47b9-bcd3-d74811ac779f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:51.826165 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b42359cf-472f-47b9-bcd3-d74811ac779f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:51.827430 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b42359cf-472f-47b9-bcd3-d74811ac779f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:51.828471 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b42359cf-472f-47b9-bcd3-d74811ac779f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:51.829420 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b42359cf-472f-47b9-bcd3-d74811ac779f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:52.076468 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-b42359cf-472f-47b9-bcd3-d74811ac779f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:52.081910 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:02:52.090373 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b42359cf-472f-47b9-bcd3-d74811ac779f tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e" status: 200 len: 1313 microversion: 2.1 time: 0.279717 Oct 11 12:02:52.091369 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 185/357] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:51 2022] GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:52.316489 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-07df7bd1-a172-4384-9fc2-f136da2c285c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:52.320221 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-07df7bd1-a172-4384-9fc2-f136da2c285c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:52.335890 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-07df7bd1-a172-4384-9fc2-f136da2c285c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:52.336981 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-07df7bd1-a172-4384-9fc2-f136da2c285c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:52.337718 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-07df7bd1-a172-4384-9fc2-f136da2c285c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:52.339042 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-07df7bd1-a172-4384-9fc2-f136da2c285c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:52.339835 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-07df7bd1-a172-4384-9fc2-f136da2c285c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:52.340528 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-07df7bd1-a172-4384-9fc2-f136da2c285c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:52.439958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-07df7bd1-a172-4384-9fc2-f136da2c285c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:52.467247 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-07df7bd1-a172-4384-9fc2-f136da2c285c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1303 microversion: 2.1 time: 0.152718 Oct 11 12:02:52.467247 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 173/358] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:52 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1303 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:53.130723 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7d4729f8-0e57-41ba-bfed-702d48f5147c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:53.131821 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7d4729f8-0e57-41ba-bfed-702d48f5147c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: f2670172-9447-488d-bce1-28f4715a7d5e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:53.142723 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7d4729f8-0e57-41ba-bfed-702d48f5147c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:53.143567 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7d4729f8-0e57-41ba-bfed-702d48f5147c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:53.144201 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7d4729f8-0e57-41ba-bfed-702d48f5147c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:53.145921 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7d4729f8-0e57-41ba-bfed-702d48f5147c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:53.146837 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7d4729f8-0e57-41ba-bfed-702d48f5147c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:53.147337 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7d4729f8-0e57-41ba-bfed-702d48f5147c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:53.446527 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7d4729f8-0e57-41ba-bfed-702d48f5147c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:53.456116 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7d4729f8-0e57-41ba-bfed-702d48f5147c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e" status: 200 len: 1313 microversion: 2.1 time: 0.333247 Oct 11 12:02:53.457539 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 186/359] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:53 2022] GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e => generated 1313 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:53.516056 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-a8d9fa4d-9380-418d-ad2d-60760413b096 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:53.516756 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-a8d9fa4d-9380-418d-ad2d-60760413b096 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:53.523764 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a8d9fa4d-9380-418d-ad2d-60760413b096 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:53.524355 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a8d9fa4d-9380-418d-ad2d-60760413b096 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:53.525401 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a8d9fa4d-9380-418d-ad2d-60760413b096 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:53.526595 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a8d9fa4d-9380-418d-ad2d-60760413b096 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:53.527433 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a8d9fa4d-9380-418d-ad2d-60760413b096 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:53.528180 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a8d9fa4d-9380-418d-ad2d-60760413b096 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:53.708664 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-a8d9fa4d-9380-418d-ad2d-60760413b096 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:53.717628 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-a8d9fa4d-9380-418d-ad2d-60760413b096 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1371 microversion: 2.1 time: 0.205729 Oct 11 12:02:53.718570 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 174/360] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:53 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1371 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:53.749581 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-886a3c07-e2d7-41f3-9394-e9026d111de3 req-cebe8ee6-6f57-446a-8933-05c77ff63261 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1be649cc-66ab-45f6-8477-19a7263944fa", "tag": "264946f8-afe2-4e00-bb9a-a5a0027ee444"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:02:53.783397 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-886a3c07-e2d7-41f3-9394-e9026d111de3 req-cebe8ee6-6f57-446a-8933-05c77ff63261 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:53.784202 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-886a3c07-e2d7-41f3-9394-e9026d111de3 req-cebe8ee6-6f57-446a-8933-05c77ff63261 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:53.784691 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-886a3c07-e2d7-41f3-9394-e9026d111de3 req-cebe8ee6-6f57-446a-8933-05c77ff63261 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:53.805777 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-886a3c07-e2d7-41f3-9394-e9026d111de3 req-cebe8ee6-6f57-446a-8933-05c77ff63261 service nova] Creating event network-changed:264946f8-afe2-4e00-bb9a-a5a0027ee444 for instance 1be649cc-66ab-45f6-8477-19a7263944fa on hv-cinder-82099 Oct 11 12:02:53.811210 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-886a3c07-e2d7-41f3-9394-e9026d111de3 req-cebe8ee6-6f57-446a-8933-05c77ff63261 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066233 Oct 11 12:02:53.812237 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 187/361] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:02:54.483182 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-080a8431-dc6d-4f57-87d0-b160f316e38a tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:54.484055 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-080a8431-dc6d-4f57-87d0-b160f316e38a tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: f2670172-9447-488d-bce1-28f4715a7d5e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:54.492195 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-080a8431-dc6d-4f57-87d0-b160f316e38a tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:54.492696 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-080a8431-dc6d-4f57-87d0-b160f316e38a tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:54.493137 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-080a8431-dc6d-4f57-87d0-b160f316e38a tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:54.493868 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-080a8431-dc6d-4f57-87d0-b160f316e38a tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:54.494355 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-080a8431-dc6d-4f57-87d0-b160f316e38a tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:54.494822 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-080a8431-dc6d-4f57-87d0-b160f316e38a tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:54.663937 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-080a8431-dc6d-4f57-87d0-b160f316e38a tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:54.672998 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-080a8431-dc6d-4f57-87d0-b160f316e38a tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e" status: 200 len: 1313 microversion: 2.1 time: 0.194700 Oct 11 12:02:54.673671 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 175/362] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:54 2022] GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e => generated 1313 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:54.742342 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f385e357-4c4b-45c8-bc6b-498f3515c0c0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:54.743074 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f385e357-4c4b-45c8-bc6b-498f3515c0c0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:54.749960 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f385e357-4c4b-45c8-bc6b-498f3515c0c0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:54.750456 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f385e357-4c4b-45c8-bc6b-498f3515c0c0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:54.750912 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f385e357-4c4b-45c8-bc6b-498f3515c0c0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:54.751627 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f385e357-4c4b-45c8-bc6b-498f3515c0c0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:54.752075 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f385e357-4c4b-45c8-bc6b-498f3515c0c0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:54.752521 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f385e357-4c4b-45c8-bc6b-498f3515c0c0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:54.902857 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f385e357-4c4b-45c8-bc6b-498f3515c0c0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:54.913106 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f385e357-4c4b-45c8-bc6b-498f3515c0c0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1371 microversion: 2.1 time: 0.175941 Oct 11 12:02:54.913695 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 188/363] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:54 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:55.696362 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-0143a9c4-d98a-4605-9e97-0754a0c5dbc0 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:55.697604 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-0143a9c4-d98a-4605-9e97-0754a0c5dbc0 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: f2670172-9447-488d-bce1-28f4715a7d5e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:55.703992 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0143a9c4-d98a-4605-9e97-0754a0c5dbc0 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:55.704597 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0143a9c4-d98a-4605-9e97-0754a0c5dbc0 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:55.705225 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0143a9c4-d98a-4605-9e97-0754a0c5dbc0 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:55.706047 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0143a9c4-d98a-4605-9e97-0754a0c5dbc0 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:55.706586 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0143a9c4-d98a-4605-9e97-0754a0c5dbc0 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:55.707021 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0143a9c4-d98a-4605-9e97-0754a0c5dbc0 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:55.743182 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-4c165a6d-67f7-43ee-ac73-f5e7d2e06dd7 req-644753c5-9c6d-402f-855a-c6673155532a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2670172-9447-488d-bce1-28f4715a7d5e", "name": "network-vif-plugged", "status": "completed", "tag": "912cb6c1-febe-45d0-8b36-1145aa78eae6"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:02:55.757255 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-4c165a6d-67f7-43ee-ac73-f5e7d2e06dd7 req-644753c5-9c6d-402f-855a-c6673155532a service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:55.757646 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-4c165a6d-67f7-43ee-ac73-f5e7d2e06dd7 req-644753c5-9c6d-402f-855a-c6673155532a service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:55.758155 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-4c165a6d-67f7-43ee-ac73-f5e7d2e06dd7 req-644753c5-9c6d-402f-855a-c6673155532a service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:55.771204 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-4c165a6d-67f7-43ee-ac73-f5e7d2e06dd7 req-644753c5-9c6d-402f-855a-c6673155532a service nova] Creating event network-vif-plugged:912cb6c1-febe-45d0-8b36-1145aa78eae6 for instance f2670172-9447-488d-bce1-28f4715a7d5e on hv-cinder-82099 Oct 11 12:02:55.777236 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-4c165a6d-67f7-43ee-ac73-f5e7d2e06dd7 req-644753c5-9c6d-402f-855a-c6673155532a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037663 Oct 11 12:02:55.777914 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 189/364] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:02:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:02:55.944558 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a22b4ffb-7454-443d-92aa-92bef3b20a58 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:55.945964 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a22b4ffb-7454-443d-92aa-92bef3b20a58 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:55.958675 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a22b4ffb-7454-443d-92aa-92bef3b20a58 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:55.960230 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a22b4ffb-7454-443d-92aa-92bef3b20a58 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:55.961191 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a22b4ffb-7454-443d-92aa-92bef3b20a58 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:55.962697 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a22b4ffb-7454-443d-92aa-92bef3b20a58 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:55.963791 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a22b4ffb-7454-443d-92aa-92bef3b20a58 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:55.964792 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a22b4ffb-7454-443d-92aa-92bef3b20a58 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:55.979152 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-0143a9c4-d98a-4605-9e97-0754a0c5dbc0 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:55.997811 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-0143a9c4-d98a-4605-9e97-0754a0c5dbc0 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e" status: 200 len: 1313 microversion: 2.1 time: 0.305452 Oct 11 12:02:55.998856 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 176/365] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:55 2022] GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:56.183705 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a22b4ffb-7454-443d-92aa-92bef3b20a58 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:56.197554 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a22b4ffb-7454-443d-92aa-92bef3b20a58 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1371 microversion: 2.1 time: 0.260425 Oct 11 12:02:56.206400 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 190/366] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:55 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1371 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:02:57.026816 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-e8ffc21e-5780-4644-a0c9-49b153239023 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:57.026816 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-e8ffc21e-5780-4644-a0c9-49b153239023 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: f2670172-9447-488d-bce1-28f4715a7d5e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:57.032728 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e8ffc21e-5780-4644-a0c9-49b153239023 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:57.033474 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e8ffc21e-5780-4644-a0c9-49b153239023 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:57.033991 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e8ffc21e-5780-4644-a0c9-49b153239023 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:57.034815 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e8ffc21e-5780-4644-a0c9-49b153239023 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:57.035249 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e8ffc21e-5780-4644-a0c9-49b153239023 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:57.035671 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e8ffc21e-5780-4644-a0c9-49b153239023 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:57.190068 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-e8ffc21e-5780-4644-a0c9-49b153239023 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:57.194407 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=100 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:02:57.200697 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-e8ffc21e-5780-4644-a0c9-49b153239023 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e" status: 200 len: 1313 microversion: 2.1 time: 0.178948 Oct 11 12:02:57.214596 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 177/367] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:57 2022] GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:02:57.230003 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-35cea9ef-2257-4f2f-b256-489f6ccba5d6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:57.230611 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-35cea9ef-2257-4f2f-b256-489f6ccba5d6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:57.243065 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-35cea9ef-2257-4f2f-b256-489f6ccba5d6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:57.243559 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-35cea9ef-2257-4f2f-b256-489f6ccba5d6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:57.244049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-35cea9ef-2257-4f2f-b256-489f6ccba5d6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:57.244931 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-35cea9ef-2257-4f2f-b256-489f6ccba5d6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:57.245386 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-35cea9ef-2257-4f2f-b256-489f6ccba5d6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:57.245932 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-35cea9ef-2257-4f2f-b256-489f6ccba5d6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:57.663447 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-35cea9ef-2257-4f2f-b256-489f6ccba5d6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:57.676704 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-35cea9ef-2257-4f2f-b256-489f6ccba5d6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1371 microversion: 2.1 time: 0.450837 Oct 11 12:02:57.699790 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 191/368] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:57 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1371 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:58.225268 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-27e8c0e7-99ab-4afe-83bb-7853f9598628 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:58.226522 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-27e8c0e7-99ab-4afe-83bb-7853f9598628 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: f2670172-9447-488d-bce1-28f4715a7d5e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:58.234441 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-27e8c0e7-99ab-4afe-83bb-7853f9598628 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:58.235273 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-27e8c0e7-99ab-4afe-83bb-7853f9598628 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:58.235803 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-27e8c0e7-99ab-4afe-83bb-7853f9598628 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:58.236682 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-27e8c0e7-99ab-4afe-83bb-7853f9598628 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:58.237355 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-27e8c0e7-99ab-4afe-83bb-7853f9598628 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:58.237787 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-27e8c0e7-99ab-4afe-83bb-7853f9598628 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:58.443628 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-27e8c0e7-99ab-4afe-83bb-7853f9598628 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:58.465041 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-27e8c0e7-99ab-4afe-83bb-7853f9598628 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e" status: 200 len: 1313 microversion: 2.1 time: 0.239463 Oct 11 12:02:58.465852 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 178/369] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:58 2022] GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e => generated 1313 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:58.714841 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-23450f5b-aed1-48c8-812a-eb7f98e11ece tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:58.715989 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-23450f5b-aed1-48c8-812a-eb7f98e11ece tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:58.724833 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-23450f5b-aed1-48c8-812a-eb7f98e11ece tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:58.725434 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-23450f5b-aed1-48c8-812a-eb7f98e11ece tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:58.725982 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-23450f5b-aed1-48c8-812a-eb7f98e11ece tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:58.726920 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-23450f5b-aed1-48c8-812a-eb7f98e11ece tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:58.727496 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-23450f5b-aed1-48c8-812a-eb7f98e11ece tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:58.728231 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-23450f5b-aed1-48c8-812a-eb7f98e11ece tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:59.129125 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-23450f5b-aed1-48c8-812a-eb7f98e11ece tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:59.140291 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-23450f5b-aed1-48c8-812a-eb7f98e11ece tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1371 microversion: 2.1 time: 0.430511 Oct 11 12:02:59.141174 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 192/370] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:58 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1371 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:02:59.500389 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-072a2bdf-50fc-4745-b0e3-4244cbab0da7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:02:59.501008 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-072a2bdf-50fc-4745-b0e3-4244cbab0da7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: f2670172-9447-488d-bce1-28f4715a7d5e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:02:59.508045 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-072a2bdf-50fc-4745-b0e3-4244cbab0da7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:59.508801 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-072a2bdf-50fc-4745-b0e3-4244cbab0da7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:59.509220 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-072a2bdf-50fc-4745-b0e3-4244cbab0da7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:59.510135 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-072a2bdf-50fc-4745-b0e3-4244cbab0da7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:59.510681 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-072a2bdf-50fc-4745-b0e3-4244cbab0da7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:59.511097 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-072a2bdf-50fc-4745-b0e3-4244cbab0da7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:02:59.706310 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-072a2bdf-50fc-4745-b0e3-4244cbab0da7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:02:59.716875 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-072a2bdf-50fc-4745-b0e3-4244cbab0da7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e" status: 200 len: 1496 microversion: 2.1 time: 0.221445 Oct 11 12:02:59.717646 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 179/371] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:02:59 2022] GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e => generated 1496 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:02:59.956613 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-6ae4d778-66a3-470b-9175-5b8dbb9a706f req-5b3e796f-d90b-4402-9718-51c44da9dd32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1be649cc-66ab-45f6-8477-19a7263944fa", "name": "network-vif-plugged", "status": "completed", "tag": "264946f8-afe2-4e00-bb9a-a5a0027ee444"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:02:59.983442 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-6ae4d778-66a3-470b-9175-5b8dbb9a706f req-5b3e796f-d90b-4402-9718-51c44da9dd32 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:02:59.985148 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-6ae4d778-66a3-470b-9175-5b8dbb9a706f req-5b3e796f-d90b-4402-9718-51c44da9dd32 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:02:59.985945 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-6ae4d778-66a3-470b-9175-5b8dbb9a706f req-5b3e796f-d90b-4402-9718-51c44da9dd32 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:00.011633 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=2 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:03:00.016945 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-6ae4d778-66a3-470b-9175-5b8dbb9a706f req-5b3e796f-d90b-4402-9718-51c44da9dd32 service nova] Creating event network-vif-plugged:264946f8-afe2-4e00-bb9a-a5a0027ee444 for instance 1be649cc-66ab-45f6-8477-19a7263944fa on hv-cinder-82099 Oct 11 12:03:00.028054 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-6ae4d778-66a3-470b-9175-5b8dbb9a706f req-5b3e796f-d90b-4402-9718-51c44da9dd32 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078900 Oct 11 12:03:00.029544 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 193/372] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 12:03:00.174732 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-0f13366d-9f1b-4020-b558-b6c5f6510b7f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:00.176476 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-0f13366d-9f1b-4020-b558-b6c5f6510b7f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:00.186239 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell0:SELECT=6 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:03:00.197803 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0f13366d-9f1b-4020-b558-b6c5f6510b7f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:00.198953 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0f13366d-9f1b-4020-b558-b6c5f6510b7f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:00.200274 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0f13366d-9f1b-4020-b558-b6c5f6510b7f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:00.202132 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0f13366d-9f1b-4020-b558-b6c5f6510b7f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:00.202773 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0f13366d-9f1b-4020-b558-b6c5f6510b7f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:00.203346 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0f13366d-9f1b-4020-b558-b6c5f6510b7f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:00.421094 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-0f13366d-9f1b-4020-b558-b6c5f6510b7f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:00.430912 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-0f13366d-9f1b-4020-b558-b6c5f6510b7f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1371 microversion: 2.1 time: 0.266241 Oct 11 12:03:00.431384 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 180/373] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:00 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1371 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:00.697906 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=6 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:03:00.708519 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-04e5dc67-e01c-41d8-b631-db3a800371c7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:00.709646 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-04e5dc67-e01c-41d8-b631-db3a800371c7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: f2670172-9447-488d-bce1-28f4715a7d5e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:00.722987 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04e5dc67-e01c-41d8-b631-db3a800371c7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:00.723859 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04e5dc67-e01c-41d8-b631-db3a800371c7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:00.724647 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04e5dc67-e01c-41d8-b631-db3a800371c7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:00.725866 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04e5dc67-e01c-41d8-b631-db3a800371c7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:00.726720 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04e5dc67-e01c-41d8-b631-db3a800371c7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:00.727524 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04e5dc67-e01c-41d8-b631-db3a800371c7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:00.744226 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-ca58e1d1-54e1-477d-9f72-9b2cd22e9998 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1028547937", "imageRef": "09bcc8f8-a32f-4ec8-9ab2-a98964ad6a01", "flavorRef": "452"}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:03:00.780891 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-04e5dc67-e01c-41d8-b631-db3a800371c7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: f2670172-9447-488d-bce1-28f4715a7d5e] Going to try to terminate instance {{(pid=118995) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 12:03:00.838660 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.network.neutron [None req-ca58e1d1-54e1-477d-9f72-9b2cd22e9998 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] validate_networks() for None {{(pid=118994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 12:03:00.920622 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-04e5dc67-e01c-41d8-b631-db3a800371c7 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "DELETE /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e" status: 204 len: 0 microversion: 2.1 time: 0.224144 Oct 11 12:03:00.922128 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 194/374] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Oct 11 12:03:00 2022] DELETE /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 12:03:00.935503 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-bfdca301-a8bc-4493-926e-a4a84e2e2e66 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:00.936339 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-bfdca301-a8bc-4493-926e-a4a84e2e2e66 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: f2670172-9447-488d-bce1-28f4715a7d5e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:00.943984 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bfdca301-a8bc-4493-926e-a4a84e2e2e66 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:00.944783 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bfdca301-a8bc-4493-926e-a4a84e2e2e66 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:00.945483 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bfdca301-a8bc-4493-926e-a4a84e2e2e66 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:00.946597 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bfdca301-a8bc-4493-926e-a4a84e2e2e66 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:00.947268 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bfdca301-a8bc-4493-926e-a4a84e2e2e66 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:00.948039 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bfdca301-a8bc-4493-926e-a4a84e2e2e66 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:01.138801 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-bfdca301-a8bc-4493-926e-a4a84e2e2e66 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:01.152415 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-bfdca301-a8bc-4493-926e-a4a84e2e2e66 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e" status: 200 len: 1502 microversion: 2.1 time: 0.223589 Oct 11 12:03:01.153500 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 195/375] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:00 2022] GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e => generated 1502 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:01.234051 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-ca58e1d1-54e1-477d-9f72-9b2cd22e9998 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Flavor limits 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 12:03:01.234869 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-ca58e1d1-54e1-477d-9f72-9b2cd22e9998 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Image limits 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 12:03:01.236016 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-ca58e1d1-54e1-477d-9f72-9b2cd22e9998 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Flavor pref 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 12:03:01.237079 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-ca58e1d1-54e1-477d-9f72-9b2cd22e9998 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Image pref 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 12:03:01.238076 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-ca58e1d1-54e1-477d-9f72-9b2cd22e9998 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 12:03:01.254246 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ca58e1d1-54e1-477d-9f72-9b2cd22e9998 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:01.254905 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ca58e1d1-54e1-477d-9f72-9b2cd22e9998 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:01.255433 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ca58e1d1-54e1-477d-9f72-9b2cd22e9998 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:01.256383 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ca58e1d1-54e1-477d-9f72-9b2cd22e9998 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:01.256932 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ca58e1d1-54e1-477d-9f72-9b2cd22e9998 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:01.257698 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ca58e1d1-54e1-477d-9f72-9b2cd22e9998 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:01.280729 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-ca58e1d1-54e1-477d-9f72-9b2cd22e9998 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Getting quotas for project 66d90ea7f97c48b4b1c026fedd768ae8. Resources: {'ram', 'instances', 'cores'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 12:03:01.285411 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-ca58e1d1-54e1-477d-9f72-9b2cd22e9998 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Getting quotas for user c336c1557b834864a1f2439f057d80f0 and project 66d90ea7f97c48b4b1c026fedd768ae8. Resources: {'ram', 'instances', 'cores'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 12:03:01.298425 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-ca58e1d1-54e1-477d-9f72-9b2cd22e9998 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Going to run 1 instances... {{(pid=118994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 12:03:01.300879 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-ca58e1d1-54e1-477d-9f72-9b2cd22e9998 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] [instance: 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09bcc8f8-a32f-4ec8-9ab2-a98964ad6a01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 12:03:01.351945 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-ca58e1d1-54e1-477d-9f72-9b2cd22e9998 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.616294 Oct 11 12:03:01.352965 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 181/376] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Oct 11 12:03:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 12:03:01.366789 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b7dd2fa4-2bd1-41c4-8e37-c0d1083f7825 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:01.367523 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-b7dd2fa4-2bd1-41c4-8e37-c0d1083f7825 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] [instance: 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:01.432804 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-b7dd2fa4-2bd1-41c4-8e37-c0d1083f7825 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c336c1557b834864a1f2439f057d80f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d90ea7f97c48b4b1c026fedd768ae8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:01.441710 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b7dd2fa4-2bd1-41c4-8e37-c0d1083f7825 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] 10.222.0.59 "GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e" status: 200 len: 1215 microversion: 2.1 time: 0.079412 Oct 11 12:03:01.442361 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 196/377] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:01 2022] GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e => generated 1215 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:01.454962 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-09c24ba0-6eab-4a9e-bb32-7a283f283e54 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:01.455757 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-09c24ba0-6eab-4a9e-bb32-7a283f283e54 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:01.458393 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:03:01.467980 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-09c24ba0-6eab-4a9e-bb32-7a283f283e54 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:01.469105 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-09c24ba0-6eab-4a9e-bb32-7a283f283e54 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:01.469962 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-09c24ba0-6eab-4a9e-bb32-7a283f283e54 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:01.471523 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-09c24ba0-6eab-4a9e-bb32-7a283f283e54 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:01.471982 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-09c24ba0-6eab-4a9e-bb32-7a283f283e54 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:01.472426 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-09c24ba0-6eab-4a9e-bb32-7a283f283e54 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:01.686905 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-09c24ba0-6eab-4a9e-bb32-7a283f283e54 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:01.699094 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-09c24ba0-6eab-4a9e-bb32-7a283f283e54 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1371 microversion: 2.1 time: 0.247448 Oct 11 12:03:01.700329 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 182/378] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:01 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1371 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:02.181048 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8e33dfed-e2b9-4da0-a0a7-7d8409a4c048 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:02.182536 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8e33dfed-e2b9-4da0-a0a7-7d8409a4c048 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: f2670172-9447-488d-bce1-28f4715a7d5e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:02.198531 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8e33dfed-e2b9-4da0-a0a7-7d8409a4c048 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:02.199664 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8e33dfed-e2b9-4da0-a0a7-7d8409a4c048 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:02.200832 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8e33dfed-e2b9-4da0-a0a7-7d8409a4c048 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:02.202229 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8e33dfed-e2b9-4da0-a0a7-7d8409a4c048 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:02.203096 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8e33dfed-e2b9-4da0-a0a7-7d8409a4c048 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:02.203887 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8e33dfed-e2b9-4da0-a0a7-7d8409a4c048 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:02.364405 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8e33dfed-e2b9-4da0-a0a7-7d8409a4c048 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:02.372606 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8e33dfed-e2b9-4da0-a0a7-7d8409a4c048 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e" status: 200 len: 1502 microversion: 2.1 time: 0.197465 Oct 11 12:03:02.373278 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 197/379] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:02 2022] GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e => generated 1502 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:02.471698 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-9b0920b3-fa26-4ea9-9df5-7a3e902a0227 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:02.472315 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-9b0920b3-fa26-4ea9-9df5-7a3e902a0227 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] [instance: 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:02.478890 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9b0920b3-fa26-4ea9-9df5-7a3e902a0227 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:02.479363 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9b0920b3-fa26-4ea9-9df5-7a3e902a0227 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:02.479805 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9b0920b3-fa26-4ea9-9df5-7a3e902a0227 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:02.480529 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9b0920b3-fa26-4ea9-9df5-7a3e902a0227 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:02.480951 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9b0920b3-fa26-4ea9-9df5-7a3e902a0227 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:02.481366 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9b0920b3-fa26-4ea9-9df5-7a3e902a0227 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:02.566675 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-9b0920b3-fa26-4ea9-9df5-7a3e902a0227 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c336c1557b834864a1f2439f057d80f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d90ea7f97c48b4b1c026fedd768ae8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:02.574865 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-9b0920b3-fa26-4ea9-9df5-7a3e902a0227 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] 10.222.0.59 "GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e" status: 200 len: 1219 microversion: 2.1 time: 0.107206 Oct 11 12:03:02.575455 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 183/380] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:02 2022] GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e => generated 1219 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:02.740331 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-fc4e05cc-14f2-43b0-8885-df6b5ec73d56 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:02.741084 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-fc4e05cc-14f2-43b0-8885-df6b5ec73d56 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:02.748448 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fc4e05cc-14f2-43b0-8885-df6b5ec73d56 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:02.749069 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fc4e05cc-14f2-43b0-8885-df6b5ec73d56 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:02.749602 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fc4e05cc-14f2-43b0-8885-df6b5ec73d56 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:02.750693 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fc4e05cc-14f2-43b0-8885-df6b5ec73d56 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:02.751183 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fc4e05cc-14f2-43b0-8885-df6b5ec73d56 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:02.751762 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fc4e05cc-14f2-43b0-8885-df6b5ec73d56 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:02.925407 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-fc4e05cc-14f2-43b0-8885-df6b5ec73d56 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:02.935792 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-fc4e05cc-14f2-43b0-8885-df6b5ec73d56 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1371 microversion: 2.1 time: 0.200192 Oct 11 12:03:02.936382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 198/381] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:02 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1371 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:03.399453 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-9c5f0866-ab90-46d2-89c1-040a1a9e024c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:03.400462 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-9c5f0866-ab90-46d2-89c1-040a1a9e024c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: f2670172-9447-488d-bce1-28f4715a7d5e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:03.407581 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9c5f0866-ab90-46d2-89c1-040a1a9e024c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:03.408088 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9c5f0866-ab90-46d2-89c1-040a1a9e024c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:03.408522 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9c5f0866-ab90-46d2-89c1-040a1a9e024c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:03.409274 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9c5f0866-ab90-46d2-89c1-040a1a9e024c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:03.409730 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9c5f0866-ab90-46d2-89c1-040a1a9e024c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:03.410147 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9c5f0866-ab90-46d2-89c1-040a1a9e024c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:03.600666 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-9c5f0866-ab90-46d2-89c1-040a1a9e024c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:03.602942 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d5a30c76-15f7-4d5b-a3ea-fb95c4fde391 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:03.603750 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d5a30c76-15f7-4d5b-a3ea-fb95c4fde391 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] [instance: 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:03.612976 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d5a30c76-15f7-4d5b-a3ea-fb95c4fde391 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:03.613659 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-9c5f0866-ab90-46d2-89c1-040a1a9e024c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e" status: 200 len: 1502 microversion: 2.1 time: 0.217963 Oct 11 12:03:03.613803 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d5a30c76-15f7-4d5b-a3ea-fb95c4fde391 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:03.614219 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d5a30c76-15f7-4d5b-a3ea-fb95c4fde391 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:03.614732 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 184/382] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:03 2022] GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e => generated 1502 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:03.615308 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d5a30c76-15f7-4d5b-a3ea-fb95c4fde391 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:03.615993 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d5a30c76-15f7-4d5b-a3ea-fb95c4fde391 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:03.616661 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d5a30c76-15f7-4d5b-a3ea-fb95c4fde391 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:03.699159 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d5a30c76-15f7-4d5b-a3ea-fb95c4fde391 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c336c1557b834864a1f2439f057d80f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d90ea7f97c48b4b1c026fedd768ae8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:03.710118 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d5a30c76-15f7-4d5b-a3ea-fb95c4fde391 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] 10.222.0.59 "GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e" status: 200 len: 1211 microversion: 2.1 time: 0.113092 Oct 11 12:03:03.711058 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 199/383] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:03 2022] GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e => generated 1211 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:03.962599 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-f3cc8e3d-7d18-4733-9680-77745fee875e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:03.963513 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-f3cc8e3d-7d18-4733-9680-77745fee875e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:03.971722 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f3cc8e3d-7d18-4733-9680-77745fee875e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:03.972212 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f3cc8e3d-7d18-4733-9680-77745fee875e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:03.972683 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f3cc8e3d-7d18-4733-9680-77745fee875e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:03.973485 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f3cc8e3d-7d18-4733-9680-77745fee875e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:03.973989 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f3cc8e3d-7d18-4733-9680-77745fee875e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:03.974410 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f3cc8e3d-7d18-4733-9680-77745fee875e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:04.137565 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-f3cc8e3d-7d18-4733-9680-77745fee875e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:04.146496 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-f3cc8e3d-7d18-4733-9680-77745fee875e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1565 microversion: 2.1 time: 0.188153 Oct 11 12:03:04.147137 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 185/384] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:03 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1565 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:04.185473 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3599c549-bcd6-4893-89aa-d731ad67a626 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:04.185969 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-3599c549-bcd6-4893-89aa-d731ad67a626 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:04.193456 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3599c549-bcd6-4893-89aa-d731ad67a626 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:04.194181 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3599c549-bcd6-4893-89aa-d731ad67a626 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:04.195177 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3599c549-bcd6-4893-89aa-d731ad67a626 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:04.196295 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3599c549-bcd6-4893-89aa-d731ad67a626 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:04.197013 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3599c549-bcd6-4893-89aa-d731ad67a626 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:04.197657 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3599c549-bcd6-4893-89aa-d731ad67a626 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:04.285093 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-3599c549-bcd6-4893-89aa-d731ad67a626 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103563 Oct 11 12:03:04.285932 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 200/385] 10.222.0.59 () {58 vars in 1275 bytes} [Tue Oct 11 12:03:04 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa/os-interface => generated 284 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:03:04.656498 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-b28e7282-3270-499a-9751-c0d3c1424774 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:04.657720 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-b28e7282-3270-499a-9751-c0d3c1424774 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: f2670172-9447-488d-bce1-28f4715a7d5e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:04.671107 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b28e7282-3270-499a-9751-c0d3c1424774 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:04.671972 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b28e7282-3270-499a-9751-c0d3c1424774 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:04.672774 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b28e7282-3270-499a-9751-c0d3c1424774 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:04.674047 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b28e7282-3270-499a-9751-c0d3c1424774 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:04.674919 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b28e7282-3270-499a-9751-c0d3c1424774 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:04.675677 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b28e7282-3270-499a-9751-c0d3c1424774 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:04.742346 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-688df468-c098-4fd6-b55f-c664704c18d4 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:04.743440 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-688df468-c098-4fd6-b55f-c664704c18d4 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] [instance: 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:04.758117 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-688df468-c098-4fd6-b55f-c664704c18d4 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:04.759589 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-688df468-c098-4fd6-b55f-c664704c18d4 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:04.760516 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-688df468-c098-4fd6-b55f-c664704c18d4 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:04.762234 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-688df468-c098-4fd6-b55f-c664704c18d4 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:04.763319 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-688df468-c098-4fd6-b55f-c664704c18d4 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:04.764295 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-688df468-c098-4fd6-b55f-c664704c18d4 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:04.910585 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-b28e7282-3270-499a-9751-c0d3c1424774 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:04.924093 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-b28e7282-3270-499a-9751-c0d3c1424774 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e" status: 200 len: 1502 microversion: 2.1 time: 0.275681 Oct 11 12:03:04.932362 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 186/386] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:04 2022] GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e => generated 1502 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:04.975419 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-688df468-c098-4fd6-b55f-c664704c18d4 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c336c1557b834864a1f2439f057d80f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d90ea7f97c48b4b1c026fedd768ae8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:04.987731 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-688df468-c098-4fd6-b55f-c664704c18d4 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] 10.222.0.59 "GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e" status: 200 len: 1211 microversion: 2.1 time: 0.253802 Oct 11 12:03:04.989013 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 201/387] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:04 2022] GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e => generated 1211 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:03:05.864631 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-d485f34b-62c9-44e4-8496-d4ed839340e6 req-bb4b3d80-a24d-470f-8233-60ca78318a31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2670172-9447-488d-bce1-28f4715a7d5e", "name": "network-vif-deleted", "tag": "912cb6c1-febe-45d0-8b36-1145aa78eae6"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:03:05.875829 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-d485f34b-62c9-44e4-8496-d4ed839340e6 req-bb4b3d80-a24d-470f-8233-60ca78318a31 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:05.876561 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-d485f34b-62c9-44e4-8496-d4ed839340e6 req-bb4b3d80-a24d-470f-8233-60ca78318a31 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:05.877066 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-d485f34b-62c9-44e4-8496-d4ed839340e6 req-bb4b3d80-a24d-470f-8233-60ca78318a31 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:05.892466 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-d485f34b-62c9-44e4-8496-d4ed839340e6 req-bb4b3d80-a24d-470f-8233-60ca78318a31 service nova] Creating event network-vif-deleted:912cb6c1-febe-45d0-8b36-1145aa78eae6 for instance f2670172-9447-488d-bce1-28f4715a7d5e on hv-cinder-82099 Oct 11 12:03:05.898830 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-d485f34b-62c9-44e4-8496-d4ed839340e6 req-bb4b3d80-a24d-470f-8233-60ca78318a31 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037940 Oct 11 12:03:05.900080 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 187/388] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:03:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 12:03:05.950007 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ae00ac86-7634-446c-b85c-bce5c42a9910 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:05.951160 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ae00ac86-7634-446c-b85c-bce5c42a9910 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: f2670172-9447-488d-bce1-28f4715a7d5e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:05.959054 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ae00ac86-7634-446c-b85c-bce5c42a9910 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:05.959647 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ae00ac86-7634-446c-b85c-bce5c42a9910 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:05.960151 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ae00ac86-7634-446c-b85c-bce5c42a9910 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:05.960991 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ae00ac86-7634-446c-b85c-bce5c42a9910 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:05.961515 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ae00ac86-7634-446c-b85c-bce5c42a9910 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:05.962003 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ae00ac86-7634-446c-b85c-bce5c42a9910 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:06.026107 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-3e32932c-c15d-402c-b920-76f0890907e3 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:06.027436 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-3e32932c-c15d-402c-b920-76f0890907e3 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] [instance: 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:06.038178 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3e32932c-c15d-402c-b920-76f0890907e3 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:06.039010 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3e32932c-c15d-402c-b920-76f0890907e3 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:06.039703 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3e32932c-c15d-402c-b920-76f0890907e3 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:06.040139 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3e32932c-c15d-402c-b920-76f0890907e3 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:06.040829 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3e32932c-c15d-402c-b920-76f0890907e3 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:06.041239 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3e32932c-c15d-402c-b920-76f0890907e3 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:06.053902 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ae00ac86-7634-446c-b85c-bce5c42a9910 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:06.074062 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ae00ac86-7634-446c-b85c-bce5c42a9910 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e" status: 200 len: 1460 microversion: 2.1 time: 0.127625 Oct 11 12:03:06.076814 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 202/389] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:05 2022] GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e => generated 1460 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:06.138505 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-3e32932c-c15d-402c-b920-76f0890907e3 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c336c1557b834864a1f2439f057d80f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d90ea7f97c48b4b1c026fedd768ae8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:06.155062 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-3e32932c-c15d-402c-b920-76f0890907e3 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] 10.222.0.59 "GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e" status: 200 len: 1267 microversion: 2.1 time: 0.133653 Oct 11 12:03:06.156072 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 188/390] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:06 2022] GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e => generated 1267 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:03:07.107824 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2dce361a-17f0-42b9-922c-e403286f631c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:07.109190 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2dce361a-17f0-42b9-922c-e403286f631c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: f2670172-9447-488d-bce1-28f4715a7d5e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:07.119301 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2dce361a-17f0-42b9-922c-e403286f631c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:07.120341 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2dce361a-17f0-42b9-922c-e403286f631c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:07.121305 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2dce361a-17f0-42b9-922c-e403286f631c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:07.123056 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2dce361a-17f0-42b9-922c-e403286f631c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:07.123974 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2dce361a-17f0-42b9-922c-e403286f631c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:07.125129 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2dce361a-17f0-42b9-922c-e403286f631c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:07.170867 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2dce361a-17f0-42b9-922c-e403286f631c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:07.171535 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2dce361a-17f0-42b9-922c-e403286f631c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:07.171892 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2dce361a-17f0-42b9-922c-e403286f631c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:07.172355 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-2dce361a-17f0-42b9-922c-e403286f631c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lazy-loading 'fault' on Instance uuid f2670172-9447-488d-bce1-28f4715a7d5e {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:03:07.181753 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-d1158e88-24d7-4988-9ee3-687db27973a7 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:07.182597 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-d1158e88-24d7-4988-9ee3-687db27973a7 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] [instance: 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:07.191887 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d1158e88-24d7-4988-9ee3-687db27973a7 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:07.193098 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d1158e88-24d7-4988-9ee3-687db27973a7 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:07.193552 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d1158e88-24d7-4988-9ee3-687db27973a7 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:07.194308 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d1158e88-24d7-4988-9ee3-687db27973a7 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:07.194795 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d1158e88-24d7-4988-9ee3-687db27973a7 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:07.195219 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d1158e88-24d7-4988-9ee3-687db27973a7 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:07.288486 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2dce361a-17f0-42b9-922c-e403286f631c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae372b81003e41aeb654da0bcca928d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f943e2a175344e40b29c72019ba95b03', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:07.300012 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:03:07.300290 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-d1158e88-24d7-4988-9ee3-687db27973a7 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c336c1557b834864a1f2439f057d80f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d90ea7f97c48b4b1c026fedd768ae8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:07.312004 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-d1158e88-24d7-4988-9ee3-687db27973a7 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] 10.222.0.59 "GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e" status: 200 len: 1273 microversion: 2.1 time: 0.134013 Oct 11 12:03:07.326845 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2dce361a-17f0-42b9-922c-e403286f631c tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e" status: 200 len: 1303 microversion: 2.1 time: 0.222911 Oct 11 12:03:07.327774 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 189/391] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:07 2022] GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e => generated 1273 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:07.336866 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 203/392] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:07 2022] GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e => generated 1303 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:07.946916 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-e23265c6-28c0-4473-a385-f42776aa568c req-8a6f4890-d3b6-4eba-8777-c25834e769f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1be649cc-66ab-45f6-8477-19a7263944fa", "tag": "264946f8-afe2-4e00-bb9a-a5a0027ee444"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:03:07.975167 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-e23265c6-28c0-4473-a385-f42776aa568c req-8a6f4890-d3b6-4eba-8777-c25834e769f3 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:07.976231 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-e23265c6-28c0-4473-a385-f42776aa568c req-8a6f4890-d3b6-4eba-8777-c25834e769f3 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:07.977950 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-e23265c6-28c0-4473-a385-f42776aa568c req-8a6f4890-d3b6-4eba-8777-c25834e769f3 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:08.004231 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-e23265c6-28c0-4473-a385-f42776aa568c req-8a6f4890-d3b6-4eba-8777-c25834e769f3 service nova] Creating event network-changed:264946f8-afe2-4e00-bb9a-a5a0027ee444 for instance 1be649cc-66ab-45f6-8477-19a7263944fa on hv-cinder-82099 Oct 11 12:03:08.014174 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-e23265c6-28c0-4473-a385-f42776aa568c req-8a6f4890-d3b6-4eba-8777-c25834e769f3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073221 Oct 11 12:03:08.015242 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 190/393] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:03:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:03:08.343611 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7c5f4da1-9fc6-4a8f-934e-f6fe19eef64f tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:08.344818 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7c5f4da1-9fc6-4a8f-934e-f6fe19eef64f tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] [instance: 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:08.358285 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c5f4da1-9fc6-4a8f-934e-f6fe19eef64f tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:08.359234 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c5f4da1-9fc6-4a8f-934e-f6fe19eef64f tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:08.359887 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c5f4da1-9fc6-4a8f-934e-f6fe19eef64f tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:08.361136 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c5f4da1-9fc6-4a8f-934e-f6fe19eef64f tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:08.362489 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c5f4da1-9fc6-4a8f-934e-f6fe19eef64f tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:08.363742 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c5f4da1-9fc6-4a8f-934e-f6fe19eef64f tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:08.384139 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-16110766-c843-4819-98e9-a679ea88c374 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:08.384139 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-16110766-c843-4819-98e9-a679ea88c374 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] [instance: f2670172-9447-488d-bce1-28f4715a7d5e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:08.396974 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-16110766-c843-4819-98e9-a679ea88c374 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:08.398191 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-16110766-c843-4819-98e9-a679ea88c374 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:08.399263 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-16110766-c843-4819-98e9-a679ea88c374 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:08.401579 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-16110766-c843-4819-98e9-a679ea88c374 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:08.402651 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-16110766-c843-4819-98e9-a679ea88c374 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:08.403653 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-16110766-c843-4819-98e9-a679ea88c374 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:08.446229 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.wsgi [None req-16110766-c843-4819-98e9-a679ea88c374 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] HTTP exception thrown: Instance f2670172-9447-488d-bce1-28f4715a7d5e could not be found. Oct 11 12:03:08.448898 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-16110766-c843-4819-98e9-a679ea88c374 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Request method failure captured: Oct 11 12:03:08.448898 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: request: GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e HTTP/1.1 Oct 11 12:03:08.448898 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept: application/json Oct 11 12:03:08.448898 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept-Encoding: identity Oct 11 12:03:08.448898 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Connection: close Oct 11 12:03:08.448898 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Length: 0 Oct 11 12:03:08.448898 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Type: application/json Oct 11 12:03:08.448898 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Host: 10.222.0.59 Oct 11 12:03:08.448898 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Openstack-System-Scope: None Oct 11 12:03:08.448898 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: User-Agent: python-urllib3/1.26.12 Oct 11 12:03:08.448898 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Auth-Token: gAAAAABjRVsij9q-JibmF83Gz45_QByFLPA8dDAC19AOY0c0oYH-ekbSxiLMI129JDu-r9RHIRpCY5CPD1vwSUR5kBvHx7xi4yXx9yZfndU2yXzjDtMusZKfwgaxnZ6kGIXkDJ-UvQw0_MDrsj_gmBBqbDAGPW9HFa0AMaZuninGObmHvSWpoi0 Oct 11 12:03:08.448898 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Id: None Oct 11 12:03:08.448898 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Name: None Oct 11 12:03:08.448898 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Identity-Status: Confirmed Oct 11 12:03:08.448898 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Is-Admin-Project: True Oct 11 12:03:08.448898 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Id: default Oct 11 12:03:08.448898 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Name: Default Oct 11 12:03:08.448898 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Id: f943e2a175344e40b29c72019ba95b03 Oct 11 12:03:08.448898 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Name: tempest-VolumesActionsTest-228528782 Oct 11 12:03:08.448898 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Role: reader,member Oct 11 12:03:08.448898 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Roles: reader,member Oct 11 12:03:08.451244 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f943e2a175344e40b29c72019ba95b03"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f943e2a175344e40b29c72019ba95b03"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f943e2a175344e40b29c72019ba95b03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f943e2a175344e40b29c72019ba95b03"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:03:08.451244 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant: tempest-VolumesActionsTest-228528782 Oct 11 12:03:08.451244 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Id: f943e2a175344e40b29c72019ba95b03 Oct 11 12:03:08.451244 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Name: tempest-VolumesActionsTest-228528782 Oct 11 12:03:08.451244 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User: tempest-VolumesActionsTest-228528782-project Oct 11 12:03:08.451244 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Id: default Oct 11 12:03:08.451244 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Name: Default Oct 11 12:03:08.451244 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Id: ae372b81003e41aeb654da0bcca928d5 Oct 11 12:03:08.451244 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Name: tempest-VolumesActionsTest-228528782-project Oct 11 12:03:08.451244 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: method: > Oct 11 12:03:08.451244 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: exception: Instance f2670172-9447-488d-bce1-28f4715a7d5e could not be found. Oct 11 12:03:08.451244 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: action_args: {'id': 'f2670172-9447-488d-bce1-28f4715a7d5e'} Oct 11 12:03:08.452420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:03:08.452420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:03:08.452420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:03:08.452420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:03:08.452420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:03:08.452420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:03:08.452420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:03:08.452420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:03:08.452420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:03:08.452420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:03:08.452420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2670172-9447-488d-bce1-28f4715a7d5e could not be found. Oct 11 12:03:08.452420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:03:08.452420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:03:08.452420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:03:08.452420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:03:08.452420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:03:08.452420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:03:08.452420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:03:08.452420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:03:08.452420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:03:08.456249 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:03:08.456249 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 12:03:08.456249 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 12:03:08.456249 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:03:08.456249 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:03:08.456249 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:03:08.456249 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:03:08.456249 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2670172-9447-488d-bce1-28f4715a7d5e could not be found. Oct 11 12:03:08.456249 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:03:08.456249 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:03:08.456249 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:03:08.456249 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:03:08.456249 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:03:08.456249 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:03:08.456249 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:03:08.456249 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:03:08.456249 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2670172-9447-488d-bce1-28f4715a7d5e could not be found. Oct 11 12:03:08.456249 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:03:08.460241 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-16110766-c843-4819-98e9-a679ea88c374 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] Returning 404 to user: Instance f2670172-9447-488d-bce1-28f4715a7d5e could not be found. {{(pid=118994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:03:08.460241 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-16110766-c843-4819-98e9-a679ea88c374 tempest-VolumesActionsTest-228528782 tempest-VolumesActionsTest-228528782-project] 10.222.0.59 "GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e" status: 404 len: 111 microversion: 2.1 time: 0.082594 Oct 11 12:03:08.460241 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 191/394] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:08 2022] GET /compute/v2.1/servers/f2670172-9447-488d-bce1-28f4715a7d5e => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:03:08.902302 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7c5f4da1-9fc6-4a8f-934e-f6fe19eef64f tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c336c1557b834864a1f2439f057d80f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d90ea7f97c48b4b1c026fedd768ae8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:08.917979 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7c5f4da1-9fc6-4a8f-934e-f6fe19eef64f tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] 10.222.0.59 "GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e" status: 200 len: 1315 microversion: 2.1 time: 0.581185 Oct 11 12:03:08.919453 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 204/395] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:08 2022] GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e => generated 1315 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:09.945405 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-759836f9-a274-4fd6-b508-656c3e29b3ec tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:09.946594 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-759836f9-a274-4fd6-b508-656c3e29b3ec tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] [instance: 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:09.954522 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-759836f9-a274-4fd6-b508-656c3e29b3ec tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:09.955187 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-759836f9-a274-4fd6-b508-656c3e29b3ec tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:09.955797 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-759836f9-a274-4fd6-b508-656c3e29b3ec tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:09.956610 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-759836f9-a274-4fd6-b508-656c3e29b3ec tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:09.957162 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-759836f9-a274-4fd6-b508-656c3e29b3ec tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:09.957811 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-759836f9-a274-4fd6-b508-656c3e29b3ec tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:10.035876 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-6634f949-4fc2-44a9-849b-a3df1fb574cc req-46581a59-f540-4ffc-9777-a30f8b2636eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9301e1cb-8deb-48fa-8778-eb5ed7cdc09e", "tag": "7e95b2a4-3b54-440f-b221-45e9745a7f5f"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:03:10.045898 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:03:10.057039 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-6634f949-4fc2-44a9-849b-a3df1fb574cc req-46581a59-f540-4ffc-9777-a30f8b2636eb service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:10.057865 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-6634f949-4fc2-44a9-849b-a3df1fb574cc req-46581a59-f540-4ffc-9777-a30f8b2636eb service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:10.058650 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-6634f949-4fc2-44a9-849b-a3df1fb574cc req-46581a59-f540-4ffc-9777-a30f8b2636eb service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:10.078759 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-6634f949-4fc2-44a9-849b-a3df1fb574cc req-46581a59-f540-4ffc-9777-a30f8b2636eb service nova] Creating event network-changed:7e95b2a4-3b54-440f-b221-45e9745a7f5f for instance 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e on hv-cinder-82099 Oct 11 12:03:10.084854 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-6634f949-4fc2-44a9-849b-a3df1fb574cc req-46581a59-f540-4ffc-9777-a30f8b2636eb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056255 Oct 11 12:03:10.085571 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 205/396] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 12:03:10.125344 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-759836f9-a274-4fd6-b508-656c3e29b3ec tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c336c1557b834864a1f2439f057d80f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d90ea7f97c48b4b1c026fedd768ae8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:10.136276 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-759836f9-a274-4fd6-b508-656c3e29b3ec tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] 10.222.0.59 "GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e" status: 200 len: 1315 microversion: 2.1 time: 0.195436 Oct 11 12:03:10.137113 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 192/397] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:09 2022] GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:11.172220 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3758aa98-eaf5-46c7-869d-88ea8d10444b tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:11.172958 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-3758aa98-eaf5-46c7-869d-88ea8d10444b tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] [instance: 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:11.180610 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3758aa98-eaf5-46c7-869d-88ea8d10444b tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:11.181105 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3758aa98-eaf5-46c7-869d-88ea8d10444b tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:11.181540 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3758aa98-eaf5-46c7-869d-88ea8d10444b tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:11.182259 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3758aa98-eaf5-46c7-869d-88ea8d10444b tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:11.182789 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3758aa98-eaf5-46c7-869d-88ea8d10444b tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:11.183196 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3758aa98-eaf5-46c7-869d-88ea8d10444b tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:11.359387 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-3758aa98-eaf5-46c7-869d-88ea8d10444b tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c336c1557b834864a1f2439f057d80f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d90ea7f97c48b4b1c026fedd768ae8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:11.375374 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-3758aa98-eaf5-46c7-869d-88ea8d10444b tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] 10.222.0.59 "GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e" status: 200 len: 1315 microversion: 2.1 time: 0.207847 Oct 11 12:03:11.376680 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 206/398] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:11 2022] GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:12.401184 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-0eb40417-4b36-4d59-a51d-459504841381 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:12.401882 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-0eb40417-4b36-4d59-a51d-459504841381 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] [instance: 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:12.404196 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell0:SELECT=2 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:03:12.404903 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell0:SELECT=6 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:03:12.412585 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0eb40417-4b36-4d59-a51d-459504841381 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:12.413077 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0eb40417-4b36-4d59-a51d-459504841381 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:12.413512 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0eb40417-4b36-4d59-a51d-459504841381 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:12.414296 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0eb40417-4b36-4d59-a51d-459504841381 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:12.414794 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0eb40417-4b36-4d59-a51d-459504841381 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:12.415209 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0eb40417-4b36-4d59-a51d-459504841381 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:12.576957 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-0eb40417-4b36-4d59-a51d-459504841381 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c336c1557b834864a1f2439f057d80f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d90ea7f97c48b4b1c026fedd768ae8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:12.590530 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-0eb40417-4b36-4d59-a51d-459504841381 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] 10.222.0.59 "GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e" status: 200 len: 1315 microversion: 2.1 time: 0.193668 Oct 11 12:03:12.591566 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 193/399] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:12 2022] GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:13.623451 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-00f68f53-852a-4e63-b8ca-4573f55957f5 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:13.625010 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-00f68f53-852a-4e63-b8ca-4573f55957f5 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] [instance: 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:13.631672 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=2 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:03:13.635829 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-00f68f53-852a-4e63-b8ca-4573f55957f5 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:13.636885 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-00f68f53-852a-4e63-b8ca-4573f55957f5 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:13.637515 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-00f68f53-852a-4e63-b8ca-4573f55957f5 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:13.638503 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-00f68f53-852a-4e63-b8ca-4573f55957f5 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:13.639087 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-00f68f53-852a-4e63-b8ca-4573f55957f5 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:13.639685 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-00f68f53-852a-4e63-b8ca-4573f55957f5 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:13.920408 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-00f68f53-852a-4e63-b8ca-4573f55957f5 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c336c1557b834864a1f2439f057d80f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d90ea7f97c48b4b1c026fedd768ae8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:13.933981 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-00f68f53-852a-4e63-b8ca-4573f55957f5 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] 10.222.0.59 "GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e" status: 200 len: 1315 microversion: 2.1 time: 0.315059 Oct 11 12:03:13.935126 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 207/400] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:13 2022] GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e => generated 1315 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:14.960701 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-f4494272-107d-4d7f-8fb0-b6c3dadb0640 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:14.961425 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-f4494272-107d-4d7f-8fb0-b6c3dadb0640 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] [instance: 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:14.969653 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f4494272-107d-4d7f-8fb0-b6c3dadb0640 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:14.970331 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f4494272-107d-4d7f-8fb0-b6c3dadb0640 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:14.970922 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f4494272-107d-4d7f-8fb0-b6c3dadb0640 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:14.971788 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f4494272-107d-4d7f-8fb0-b6c3dadb0640 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:14.972391 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f4494272-107d-4d7f-8fb0-b6c3dadb0640 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:14.972855 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f4494272-107d-4d7f-8fb0-b6c3dadb0640 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:15.189032 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-f4494272-107d-4d7f-8fb0-b6c3dadb0640 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c336c1557b834864a1f2439f057d80f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d90ea7f97c48b4b1c026fedd768ae8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:15.198108 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-f4494272-107d-4d7f-8fb0-b6c3dadb0640 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] 10.222.0.59 "GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e" status: 200 len: 1315 microversion: 2.1 time: 0.242006 Oct 11 12:03:15.198996 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 194/401] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:14 2022] GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:16.236581 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2e4a6b4d-f95f-4d60-b521-7b7a09d2895a tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:16.238923 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2e4a6b4d-f95f-4d60-b521-7b7a09d2895a tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] [instance: 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:16.251344 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2e4a6b4d-f95f-4d60-b521-7b7a09d2895a tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:16.252805 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2e4a6b4d-f95f-4d60-b521-7b7a09d2895a tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:16.253537 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2e4a6b4d-f95f-4d60-b521-7b7a09d2895a tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:16.254915 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2e4a6b4d-f95f-4d60-b521-7b7a09d2895a tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:16.255747 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2e4a6b4d-f95f-4d60-b521-7b7a09d2895a tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:16.256510 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2e4a6b4d-f95f-4d60-b521-7b7a09d2895a tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:16.464020 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2e4a6b4d-f95f-4d60-b521-7b7a09d2895a tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c336c1557b834864a1f2439f057d80f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d90ea7f97c48b4b1c026fedd768ae8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:16.482275 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2e4a6b4d-f95f-4d60-b521-7b7a09d2895a tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] 10.222.0.59 "GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e" status: 200 len: 1315 microversion: 2.1 time: 0.254287 Oct 11 12:03:16.483666 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 208/402] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:16 2022] GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:17.510883 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-7b4cdfb6-5214-4181-ad0d-a0a5e662df59 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:17.512872 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-7b4cdfb6-5214-4181-ad0d-a0a5e662df59 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] [instance: 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:17.526590 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7b4cdfb6-5214-4181-ad0d-a0a5e662df59 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:17.528251 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7b4cdfb6-5214-4181-ad0d-a0a5e662df59 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:17.529648 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7b4cdfb6-5214-4181-ad0d-a0a5e662df59 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:17.531183 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7b4cdfb6-5214-4181-ad0d-a0a5e662df59 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:17.532372 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7b4cdfb6-5214-4181-ad0d-a0a5e662df59 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:17.533343 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7b4cdfb6-5214-4181-ad0d-a0a5e662df59 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:17.752231 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-7b4cdfb6-5214-4181-ad0d-a0a5e662df59 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c336c1557b834864a1f2439f057d80f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d90ea7f97c48b4b1c026fedd768ae8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:17.763458 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-7b4cdfb6-5214-4181-ad0d-a0a5e662df59 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] 10.222.0.59 "GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e" status: 200 len: 1315 microversion: 2.1 time: 0.259017 Oct 11 12:03:17.765063 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 195/403] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:17 2022] GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e => generated 1315 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:18.802743 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ee11aec8-433b-4388-9d8d-ec66768eeb58 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:18.804312 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ee11aec8-433b-4388-9d8d-ec66768eeb58 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] [instance: 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:18.812372 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ee11aec8-433b-4388-9d8d-ec66768eeb58 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:18.813276 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ee11aec8-433b-4388-9d8d-ec66768eeb58 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:18.813939 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ee11aec8-433b-4388-9d8d-ec66768eeb58 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:18.814992 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ee11aec8-433b-4388-9d8d-ec66768eeb58 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:18.815692 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ee11aec8-433b-4388-9d8d-ec66768eeb58 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:18.816691 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ee11aec8-433b-4388-9d8d-ec66768eeb58 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:19.011817 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ee11aec8-433b-4388-9d8d-ec66768eeb58 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c336c1557b834864a1f2439f057d80f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d90ea7f97c48b4b1c026fedd768ae8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:19.025178 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ee11aec8-433b-4388-9d8d-ec66768eeb58 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] 10.222.0.59 "GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e" status: 200 len: 1315 microversion: 2.1 time: 0.226098 Oct 11 12:03:19.025764 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 209/404] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:18 2022] GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:20.049775 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-eaaffbb8-539b-48ad-9905-9dcfda62ddfc tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:20.051384 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-eaaffbb8-539b-48ad-9905-9dcfda62ddfc tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] [instance: 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:20.059458 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eaaffbb8-539b-48ad-9905-9dcfda62ddfc tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:20.060382 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eaaffbb8-539b-48ad-9905-9dcfda62ddfc tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:20.061131 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eaaffbb8-539b-48ad-9905-9dcfda62ddfc tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:20.062652 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eaaffbb8-539b-48ad-9905-9dcfda62ddfc tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:20.063418 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eaaffbb8-539b-48ad-9905-9dcfda62ddfc tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:20.064162 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eaaffbb8-539b-48ad-9905-9dcfda62ddfc tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:20.139071 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-e53820f9-6d0e-4c82-b13d-f078945af4aa req-c7727bef-3bcd-4888-a1a6-efc79332f929 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9301e1cb-8deb-48fa-8778-eb5ed7cdc09e", "name": "network-vif-plugged", "status": "completed", "tag": "7e95b2a4-3b54-440f-b221-45e9745a7f5f"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:03:20.160351 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-e53820f9-6d0e-4c82-b13d-f078945af4aa req-c7727bef-3bcd-4888-a1a6-efc79332f929 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:20.165479 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-e53820f9-6d0e-4c82-b13d-f078945af4aa req-c7727bef-3bcd-4888-a1a6-efc79332f929 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:20.166107 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-e53820f9-6d0e-4c82-b13d-f078945af4aa req-c7727bef-3bcd-4888-a1a6-efc79332f929 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:20.207335 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-e53820f9-6d0e-4c82-b13d-f078945af4aa req-c7727bef-3bcd-4888-a1a6-efc79332f929 service nova] Creating event network-vif-plugged:7e95b2a4-3b54-440f-b221-45e9745a7f5f for instance 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e on hv-cinder-82099 Oct 11 12:03:20.226994 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-e53820f9-6d0e-4c82-b13d-f078945af4aa req-c7727bef-3bcd-4888-a1a6-efc79332f929 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091557 Oct 11 12:03:20.237763 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 210/405] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:03:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 12:03:20.272736 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-eaaffbb8-539b-48ad-9905-9dcfda62ddfc tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c336c1557b834864a1f2439f057d80f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d90ea7f97c48b4b1c026fedd768ae8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:20.283373 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-eaaffbb8-539b-48ad-9905-9dcfda62ddfc tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] 10.222.0.59 "GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e" status: 200 len: 1315 microversion: 2.1 time: 0.238460 Oct 11 12:03:20.295760 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 196/406] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:20 2022] GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:03:21.309866 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7f7a3101-1c44-467c-a70b-e35c4bdb0832 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:21.310681 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7f7a3101-1c44-467c-a70b-e35c4bdb0832 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] [instance: 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:21.318245 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7f7a3101-1c44-467c-a70b-e35c4bdb0832 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:21.318770 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7f7a3101-1c44-467c-a70b-e35c4bdb0832 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:21.319205 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7f7a3101-1c44-467c-a70b-e35c4bdb0832 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:21.320081 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7f7a3101-1c44-467c-a70b-e35c4bdb0832 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:21.320732 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7f7a3101-1c44-467c-a70b-e35c4bdb0832 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:21.321153 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7f7a3101-1c44-467c-a70b-e35c4bdb0832 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:21.524329 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7f7a3101-1c44-467c-a70b-e35c4bdb0832 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c336c1557b834864a1f2439f057d80f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d90ea7f97c48b4b1c026fedd768ae8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:21.532777 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7f7a3101-1c44-467c-a70b-e35c4bdb0832 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] 10.222.0.59 "GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e" status: 200 len: 1315 microversion: 2.1 time: 0.227969 Oct 11 12:03:21.533361 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 211/407] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:21 2022] GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e => generated 1315 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:22.557304 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-7bb8ce9c-1ba2-4b4b-88c2-d41e13a82587 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:22.558075 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-7bb8ce9c-1ba2-4b4b-88c2-d41e13a82587 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] [instance: 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:22.564502 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7bb8ce9c-1ba2-4b4b-88c2-d41e13a82587 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:22.565360 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7bb8ce9c-1ba2-4b4b-88c2-d41e13a82587 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:22.565773 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7bb8ce9c-1ba2-4b4b-88c2-d41e13a82587 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:22.566474 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7bb8ce9c-1ba2-4b4b-88c2-d41e13a82587 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:22.567107 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7bb8ce9c-1ba2-4b4b-88c2-d41e13a82587 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:22.567527 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7bb8ce9c-1ba2-4b4b-88c2-d41e13a82587 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:22.573309 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=100 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:03:22.850445 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-7bb8ce9c-1ba2-4b4b-88c2-d41e13a82587 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c336c1557b834864a1f2439f057d80f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d90ea7f97c48b4b1c026fedd768ae8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:22.859497 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-7bb8ce9c-1ba2-4b4b-88c2-d41e13a82587 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] 10.222.0.59 "GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e" status: 200 len: 1464 microversion: 2.1 time: 0.306354 Oct 11 12:03:22.860086 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 197/408] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:22 2022] GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e => generated 1464 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:22.968457 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d8bd4789-fc3a-4a4a-b3f6-17ebaee7ed48 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:22.970396 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d8bd4789-fc3a-4a4a-b3f6-17ebaee7ed48 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] [instance: 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:22.981324 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d8bd4789-fc3a-4a4a-b3f6-17ebaee7ed48 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:22.982781 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d8bd4789-fc3a-4a4a-b3f6-17ebaee7ed48 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:22.983973 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d8bd4789-fc3a-4a4a-b3f6-17ebaee7ed48 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:22.985288 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d8bd4789-fc3a-4a4a-b3f6-17ebaee7ed48 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:22.985941 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d8bd4789-fc3a-4a4a-b3f6-17ebaee7ed48 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:22.986715 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d8bd4789-fc3a-4a4a-b3f6-17ebaee7ed48 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:23.047087 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d8bd4789-fc3a-4a4a-b3f6-17ebaee7ed48 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] [instance: 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e] Going to try to terminate instance {{(pid=118995) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 12:03:23.162123 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d8bd4789-fc3a-4a4a-b3f6-17ebaee7ed48 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e" status: 204 len: 0 microversion: 2.1 time: 0.199841 Oct 11 12:03:23.166806 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 212/409] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Oct 11 12:03:22 2022] DELETE /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 12:03:23.178179 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-cc108565-68e4-4776-ba5b-58cb2e449634 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:23.179682 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-cc108565-68e4-4776-ba5b-58cb2e449634 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] [instance: 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:23.191216 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cc108565-68e4-4776-ba5b-58cb2e449634 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:23.191938 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cc108565-68e4-4776-ba5b-58cb2e449634 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:23.192495 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cc108565-68e4-4776-ba5b-58cb2e449634 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:23.193916 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cc108565-68e4-4776-ba5b-58cb2e449634 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:23.194387 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cc108565-68e4-4776-ba5b-58cb2e449634 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:23.194923 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cc108565-68e4-4776-ba5b-58cb2e449634 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:23.432714 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-cc108565-68e4-4776-ba5b-58cb2e449634 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c336c1557b834864a1f2439f057d80f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d90ea7f97c48b4b1c026fedd768ae8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:23.445176 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-cc108565-68e4-4776-ba5b-58cb2e449634 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] 10.222.0.59 "GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e" status: 200 len: 1470 microversion: 2.1 time: 0.275680 Oct 11 12:03:23.445798 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 198/410] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:23 2022] GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e => generated 1470 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:24.484938 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ccaf6900-925e-4b48-9dd1-2391d0304fbc tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:24.485832 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ccaf6900-925e-4b48-9dd1-2391d0304fbc tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] [instance: 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:24.493633 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ccaf6900-925e-4b48-9dd1-2391d0304fbc tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:24.494239 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ccaf6900-925e-4b48-9dd1-2391d0304fbc tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:24.494719 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ccaf6900-925e-4b48-9dd1-2391d0304fbc tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:24.495571 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ccaf6900-925e-4b48-9dd1-2391d0304fbc tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:24.496068 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ccaf6900-925e-4b48-9dd1-2391d0304fbc tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:24.496512 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ccaf6900-925e-4b48-9dd1-2391d0304fbc tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:24.661480 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ccaf6900-925e-4b48-9dd1-2391d0304fbc tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c336c1557b834864a1f2439f057d80f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d90ea7f97c48b4b1c026fedd768ae8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:24.673121 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ccaf6900-925e-4b48-9dd1-2391d0304fbc tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] 10.222.0.59 "GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e" status: 200 len: 1470 microversion: 2.1 time: 0.192746 Oct 11 12:03:24.674162 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 213/411] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:24 2022] GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e => generated 1470 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:25.704937 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-03a74d3c-19b1-455f-9164-c28f486788b1 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:25.704937 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-03a74d3c-19b1-455f-9164-c28f486788b1 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] [instance: 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:25.705954 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-03a74d3c-19b1-455f-9164-c28f486788b1 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:25.705954 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-03a74d3c-19b1-455f-9164-c28f486788b1 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:25.706238 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-03a74d3c-19b1-455f-9164-c28f486788b1 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:25.706972 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-03a74d3c-19b1-455f-9164-c28f486788b1 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:25.707420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-03a74d3c-19b1-455f-9164-c28f486788b1 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:25.707842 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-03a74d3c-19b1-455f-9164-c28f486788b1 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:25.823832 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-03a74d3c-19b1-455f-9164-c28f486788b1 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c336c1557b834864a1f2439f057d80f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d90ea7f97c48b4b1c026fedd768ae8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:25.834643 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-03a74d3c-19b1-455f-9164-c28f486788b1 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] 10.222.0.59 "GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e" status: 200 len: 1428 microversion: 2.1 time: 0.141222 Oct 11 12:03:25.835689 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 199/412] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:25 2022] GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e => generated 1428 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:03:26.090864 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-ad9e6d40-e5b5-4916-afa1-0e76824d592f req-3ae7d887-f248-442b-ad81-e595849e6fe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9301e1cb-8deb-48fa-8778-eb5ed7cdc09e", "name": "network-vif-deleted", "tag": "7e95b2a4-3b54-440f-b221-45e9745a7f5f"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:03:26.108098 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-ad9e6d40-e5b5-4916-afa1-0e76824d592f req-3ae7d887-f248-442b-ad81-e595849e6fe8 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:26.109308 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-ad9e6d40-e5b5-4916-afa1-0e76824d592f req-3ae7d887-f248-442b-ad81-e595849e6fe8 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:26.109777 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-ad9e6d40-e5b5-4916-afa1-0e76824d592f req-3ae7d887-f248-442b-ad81-e595849e6fe8 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:26.139589 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-ad9e6d40-e5b5-4916-afa1-0e76824d592f req-3ae7d887-f248-442b-ad81-e595849e6fe8 service nova] Creating event network-vif-deleted:7e95b2a4-3b54-440f-b221-45e9745a7f5f for instance 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e on hv-cinder-82099 Oct 11 12:03:26.152330 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-ad9e6d40-e5b5-4916-afa1-0e76824d592f req-3ae7d887-f248-442b-ad81-e595849e6fe8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073101 Oct 11 12:03:26.156514 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 214/413] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:03:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:03:26.861799 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-be690be8-c493-4132-9b76-3c7c88eddb32 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:26.862421 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-be690be8-c493-4132-9b76-3c7c88eddb32 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] [instance: 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:26.869108 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-be690be8-c493-4132-9b76-3c7c88eddb32 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:26.869596 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-be690be8-c493-4132-9b76-3c7c88eddb32 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:26.870034 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-be690be8-c493-4132-9b76-3c7c88eddb32 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:26.871663 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-be690be8-c493-4132-9b76-3c7c88eddb32 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:26.874098 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-be690be8-c493-4132-9b76-3c7c88eddb32 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:26.875274 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-be690be8-c493-4132-9b76-3c7c88eddb32 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:26.923601 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-be690be8-c493-4132-9b76-3c7c88eddb32 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:26.924117 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-be690be8-c493-4132-9b76-3c7c88eddb32 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:26.924809 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-be690be8-c493-4132-9b76-3c7c88eddb32 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:26.925829 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.objects.instance [None req-be690be8-c493-4132-9b76-3c7c88eddb32 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lazy-loading 'fault' on Instance uuid 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e {{(pid=118994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:03:26.989043 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-be690be8-c493-4132-9b76-3c7c88eddb32 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c336c1557b834864a1f2439f057d80f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66d90ea7f97c48b4b1c026fedd768ae8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:27.003954 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-be690be8-c493-4132-9b76-3c7c88eddb32 tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] 10.222.0.59 "GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e" status: 200 len: 1305 microversion: 2.1 time: 0.147647 Oct 11 12:03:27.019078 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 200/414] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:26 2022] GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e => generated 1305 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:28.030994 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6b9d36fc-1608-4149-b52a-ec3478ac604e tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:28.032458 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-6b9d36fc-1608-4149-b52a-ec3478ac604e tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] [instance: 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:28.038849 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6b9d36fc-1608-4149-b52a-ec3478ac604e tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:28.039632 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6b9d36fc-1608-4149-b52a-ec3478ac604e tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:28.040288 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6b9d36fc-1608-4149-b52a-ec3478ac604e tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:28.041189 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6b9d36fc-1608-4149-b52a-ec3478ac604e tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:28.041805 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6b9d36fc-1608-4149-b52a-ec3478ac604e tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:28.042269 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6b9d36fc-1608-4149-b52a-ec3478ac604e tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:28.057417 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-6b9d36fc-1608-4149-b52a-ec3478ac604e tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] HTTP exception thrown: Instance 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e could not be found. Oct 11 12:03:28.059535 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6b9d36fc-1608-4149-b52a-ec3478ac604e tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Request method failure captured: Oct 11 12:03:28.059535 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e HTTP/1.1 Oct 11 12:03:28.059535 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 11 12:03:28.059535 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 11 12:03:28.059535 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Connection: close Oct 11 12:03:28.059535 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 11 12:03:28.059535 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 11 12:03:28.059535 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Host: 10.222.0.59 Oct 11 12:03:28.059535 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 11 12:03:28.059535 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 11 12:03:28.059535 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjRVtyb5UzF92NS3BXVQzm0p-nmukwywAaA0EAF7pityUuFVoCAmLXQH-jwewIfbmkBmKw8t9XoEzr43XML6VLM71d63gSgqHTOSvFHfV9n_u4nW9z4p2H2-9ovOeUkTT02sV7pmwnPfqNPY0dMAQv7wXcWJTCToUVyvt07BL-vz-capM Oct 11 12:03:28.059535 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 11 12:03:28.059535 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 11 12:03:28.059535 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 11 12:03:28.059535 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 11 12:03:28.059535 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 11 12:03:28.059535 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 11 12:03:28.059535 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Id: 66d90ea7f97c48b4b1c026fedd768ae8 Oct 11 12:03:28.059535 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-VolumesNegativeTest-553782755 Oct 11 12:03:28.059535 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Role: reader,member Oct 11 12:03:28.059535 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Roles: reader,member Oct 11 12:03:28.061220 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/66d90ea7f97c48b4b1c026fedd768ae8"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_66d90ea7f97c48b4b1c026fedd768ae8"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/66d90ea7f97c48b4b1c026fedd768ae8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/66d90ea7f97c48b4b1c026fedd768ae8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:03:28.061220 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-VolumesNegativeTest-553782755 Oct 11 12:03:28.061220 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 66d90ea7f97c48b4b1c026fedd768ae8 Oct 11 12:03:28.061220 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-VolumesNegativeTest-553782755 Oct 11 12:03:28.061220 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User: tempest-VolumesNegativeTest-553782755-project Oct 11 12:03:28.061220 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 11 12:03:28.061220 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 11 12:03:28.061220 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Id: c336c1557b834864a1f2439f057d80f0 Oct 11 12:03:28.061220 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-VolumesNegativeTest-553782755-project Oct 11 12:03:28.061220 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: method: > Oct 11 12:03:28.061220 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: exception: Instance 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e could not be found. Oct 11 12:03:28.061220 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: action_args: {'id': '9301e1cb-8deb-48fa-8778-eb5ed7cdc09e'} Oct 11 12:03:28.061993 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:03:28.061993 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:03:28.061993 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:03:28.061993 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:03:28.061993 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:03:28.061993 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:03:28.061993 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:03:28.061993 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:03:28.061993 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:03:28.061993 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:03:28.061993 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e could not be found. Oct 11 12:03:28.061993 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:03:28.061993 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:03:28.061993 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:03:28.061993 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:03:28.061993 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:03:28.061993 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:03:28.061993 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:03:28.061993 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:03:28.061993 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:03:28.063255 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:03:28.063255 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 12:03:28.063255 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 12:03:28.063255 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:03:28.063255 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:03:28.063255 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:03:28.063255 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:03:28.063255 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e could not be found. Oct 11 12:03:28.063255 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:03:28.063255 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:03:28.063255 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:03:28.063255 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:03:28.063255 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:03:28.063255 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:03:28.063255 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:03:28.063255 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:03:28.063255 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e could not be found. Oct 11 12:03:28.063255 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:03:28.064327 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6b9d36fc-1608-4149-b52a-ec3478ac604e tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] Returning 404 to user: Instance 9301e1cb-8deb-48fa-8778-eb5ed7cdc09e could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:03:28.064327 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6b9d36fc-1608-4149-b52a-ec3478ac604e tempest-VolumesNegativeTest-553782755 tempest-VolumesNegativeTest-553782755-project] 10.222.0.59 "GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e" status: 404 len: 111 microversion: 2.1 time: 0.036119 Oct 11 12:03:28.064327 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 215/415] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:28 2022] GET /compute/v2.1/servers/9301e1cb-8deb-48fa-8778-eb5ed7cdc09e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:03:31.063932 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-6ab1d829-6bb7-4e8e-8ec0-13f64efa8b35 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:31.064494 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-6ab1d829-6bb7-4e8e-8ec0-13f64efa8b35 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:31.071623 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6ab1d829-6bb7-4e8e-8ec0-13f64efa8b35 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:31.072167 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6ab1d829-6bb7-4e8e-8ec0-13f64efa8b35 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:31.072631 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6ab1d829-6bb7-4e8e-8ec0-13f64efa8b35 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:31.073396 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6ab1d829-6bb7-4e8e-8ec0-13f64efa8b35 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:31.074095 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6ab1d829-6bb7-4e8e-8ec0-13f64efa8b35 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:31.074815 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6ab1d829-6bb7-4e8e-8ec0-13f64efa8b35 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:31.105383 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-6ab1d829-6bb7-4e8e-8ec0-13f64efa8b35 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186/ips" status: 200 len: 151 microversion: 2.1 time: 0.045699 Oct 11 12:03:31.105967 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 201/416] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Oct 11 12:03:31 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186/ips => generated 151 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:03:33.730013 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-1e5346e9-8b08-4491-9e26-03459e8fe1c7 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47160c47-8ad8-4adc-8e54-750c06977f12"}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:03:33.732424 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-1e5346e9-8b08-4491-9e26-03459e8fe1c7 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:33.739854 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1e5346e9-8b08-4491-9e26-03459e8fe1c7 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:33.740338 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1e5346e9-8b08-4491-9e26-03459e8fe1c7 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:33.740765 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1e5346e9-8b08-4491-9e26-03459e8fe1c7 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:33.741455 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1e5346e9-8b08-4491-9e26-03459e8fe1c7 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:33.741907 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1e5346e9-8b08-4491-9e26-03459e8fe1c7 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:33.742325 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1e5346e9-8b08-4491-9e26-03459e8fe1c7 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:34.060934 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-1e5346e9-8b08-4491-9e26-03459e8fe1c7 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "POST /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.334753 Oct 11 12:03:34.061703 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 216/417] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Oct 11 12:03:33 2022] POST /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186/os-volume_attachments => generated 194 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:03:41.669007 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-cca2fe60-6dea-4ec1-b64a-8c3a03dbb5ad tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Action: 'create', calling method: .version_select at 0x7fd40758bee0>, body: {"keypair": {"name": "tempest-keypair-398869182", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPSUV85aqncgeLRDW+dE7PUI+zaEuFiljki5Z13XsER0kM7LD3mjXy4h+21MFOJVwZGNqTN1TJWubHwppAqT4BcphdnpJ7zw6au1vz66Wo8E6CC/H6fOw9aBOlp/R+cfg=="}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:03:41.674719 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_api:SELECT=41 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:03:41.675362 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=28 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:03:41.687505 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-cca2fe60-6dea-4ec1-b64a-8c3a03dbb5ad tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Getting quotas for project c83f971a0ae04288a5c6dc87d3370979. Resources: {'key_pairs'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 12:03:41.691460 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-cca2fe60-6dea-4ec1-b64a-8c3a03dbb5ad tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Getting quotas for user 41d3680dda7c4cc8aeb6d086efca0775 and project c83f971a0ae04288a5c6dc87d3370979. Resources: {'key_pairs'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 12:03:41.720711 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-cca2fe60-6dea-4ec1-b64a-8c3a03dbb5ad tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055748 Oct 11 12:03:41.721303 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 202/418] 10.222.0.59 () {60 vars in 1159 bytes} [Tue Oct 11 12:03:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:03:43.188884 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ed7176dc-d45f-4c9f-9520-8cec66337f78 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-785214284", "imageRef": "09bcc8f8-a32f-4ec8-9ab2-a98964ad6a01", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "55e10b58-1f19-4291-9200-8a870118bbcb"}], "security_groups": [{"name": "tempest-securitygroup--56758380"}], "key_name": "tempest-keypair-398869182", "user_data": "}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:03:43.197834 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:03:43.302049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.network.neutron [None req-ed7176dc-d45f-4c9f-9520-8cec66337f78 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] validate_networks() for [('55e10b58-1f19-4291-9200-8a870118bbcb', None, None, None, None, None)] {{(pid=118995) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 12:03:43.710955 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-ed7176dc-d45f-4c9f-9520-8cec66337f78 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Flavor limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 12:03:43.711646 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-ed7176dc-d45f-4c9f-9520-8cec66337f78 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Image limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 12:03:43.712169 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-ed7176dc-d45f-4c9f-9520-8cec66337f78 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Flavor pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 12:03:43.712634 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-ed7176dc-d45f-4c9f-9520-8cec66337f78 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Image pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 12:03:43.713073 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-ed7176dc-d45f-4c9f-9520-8cec66337f78 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 12:03:43.723842 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ed7176dc-d45f-4c9f-9520-8cec66337f78 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:43.724312 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ed7176dc-d45f-4c9f-9520-8cec66337f78 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:43.724740 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ed7176dc-d45f-4c9f-9520-8cec66337f78 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:43.725458 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ed7176dc-d45f-4c9f-9520-8cec66337f78 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:43.725902 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ed7176dc-d45f-4c9f-9520-8cec66337f78 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:43.726295 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ed7176dc-d45f-4c9f-9520-8cec66337f78 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:43.732941 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:03:43.745846 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-ed7176dc-d45f-4c9f-9520-8cec66337f78 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Getting quotas for project c83f971a0ae04288a5c6dc87d3370979. Resources: {'ram', 'instances', 'cores'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 12:03:43.751238 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-ed7176dc-d45f-4c9f-9520-8cec66337f78 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Getting quotas for user 41d3680dda7c4cc8aeb6d086efca0775 and project c83f971a0ae04288a5c6dc87d3370979. Resources: {'ram', 'instances', 'cores'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 12:03:43.762665 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ed7176dc-d45f-4c9f-9520-8cec66337f78 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Going to run 1 instances... {{(pid=118995) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 12:03:43.765054 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ed7176dc-d45f-4c9f-9520-8cec66337f78 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 4fb48466-ddf3-47f7-bade-b20976690c7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09bcc8f8-a32f-4ec8-9ab2-a98964ad6a01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118995) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 12:03:43.816828 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ed7176dc-d45f-4c9f-9520-8cec66337f78 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.633815 Oct 11 12:03:43.817519 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 217/419] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Oct 11 12:03:43 2022] POST /compute/v2.1/servers => generated 400 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 12:03:43.828978 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-3df76339-ac4c-4408-b416-5c9500e7d649 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:43.829766 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-3df76339-ac4c-4408-b416-5c9500e7d649 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 4fb48466-ddf3-47f7-bade-b20976690c7f] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:43.888977 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-3df76339-ac4c-4408-b416-5c9500e7d649 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:43.896444 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-3df76339-ac4c-4408-b416-5c9500e7d649 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f" status: 200 len: 1240 microversion: 2.1 time: 0.071458 Oct 11 12:03:43.897006 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 203/420] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:43 2022] GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f => generated 1240 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:03:44.921929 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-387f32c7-9d31-4472-975c-4139c5a4aa83 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:44.922470 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-387f32c7-9d31-4472-975c-4139c5a4aa83 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 4fb48466-ddf3-47f7-bade-b20976690c7f] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:44.931921 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-387f32c7-9d31-4472-975c-4139c5a4aa83 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:44.932548 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-387f32c7-9d31-4472-975c-4139c5a4aa83 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:44.933049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-387f32c7-9d31-4472-975c-4139c5a4aa83 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:44.933944 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-387f32c7-9d31-4472-975c-4139c5a4aa83 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:44.934482 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-387f32c7-9d31-4472-975c-4139c5a4aa83 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:44.934921 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-387f32c7-9d31-4472-975c-4139c5a4aa83 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:45.002821 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-387f32c7-9d31-4472-975c-4139c5a4aa83 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:45.013305 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-387f32c7-9d31-4472-975c-4139c5a4aa83 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f" status: 200 len: 1292 microversion: 2.1 time: 0.096214 Oct 11 12:03:45.013894 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 218/421] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:44 2022] GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f => generated 1292 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:46.043175 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-f1063847-b669-4174-8224-871a0777bf6b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:46.044216 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-f1063847-b669-4174-8224-871a0777bf6b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 4fb48466-ddf3-47f7-bade-b20976690c7f] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:46.055232 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f1063847-b669-4174-8224-871a0777bf6b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:46.055728 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f1063847-b669-4174-8224-871a0777bf6b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:46.056160 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f1063847-b669-4174-8224-871a0777bf6b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:46.056837 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f1063847-b669-4174-8224-871a0777bf6b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:46.057459 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f1063847-b669-4174-8224-871a0777bf6b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:46.057996 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f1063847-b669-4174-8224-871a0777bf6b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:46.258681 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-f1063847-b669-4174-8224-871a0777bf6b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:46.267622 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-f1063847-b669-4174-8224-871a0777bf6b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f" status: 200 len: 1364 microversion: 2.1 time: 0.229973 Oct 11 12:03:46.268280 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 204/422] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:46 2022] GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f => generated 1364 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:46.756807 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-0104e173-c512-43b5-bbdc-db6c0d4aeb8b req-08a65d40-dbf6-4800-8dd8-34898ffea196 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fb48466-ddf3-47f7-bade-b20976690c7f", "tag": "69c4b54f-6212-491b-948d-48cf289c20da"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:03:46.768928 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-0104e173-c512-43b5-bbdc-db6c0d4aeb8b req-08a65d40-dbf6-4800-8dd8-34898ffea196 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:46.769567 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-0104e173-c512-43b5-bbdc-db6c0d4aeb8b req-08a65d40-dbf6-4800-8dd8-34898ffea196 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:46.770319 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-0104e173-c512-43b5-bbdc-db6c0d4aeb8b req-08a65d40-dbf6-4800-8dd8-34898ffea196 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:46.783660 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-0104e173-c512-43b5-bbdc-db6c0d4aeb8b req-08a65d40-dbf6-4800-8dd8-34898ffea196 service nova] Creating event network-changed:69c4b54f-6212-491b-948d-48cf289c20da for instance 4fb48466-ddf3-47f7-bade-b20976690c7f on hv-cinder-82099 Oct 11 12:03:46.790545 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-0104e173-c512-43b5-bbdc-db6c0d4aeb8b req-08a65d40-dbf6-4800-8dd8-34898ffea196 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037721 Oct 11 12:03:46.796342 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 219/423] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:03:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:03:47.291973 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-6d52a43c-0afa-41fb-b6ae-ca336279f4f6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:47.292617 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-6d52a43c-0afa-41fb-b6ae-ca336279f4f6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 4fb48466-ddf3-47f7-bade-b20976690c7f] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:47.299460 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6d52a43c-0afa-41fb-b6ae-ca336279f4f6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:47.299941 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6d52a43c-0afa-41fb-b6ae-ca336279f4f6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:47.300411 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6d52a43c-0afa-41fb-b6ae-ca336279f4f6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:47.301109 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6d52a43c-0afa-41fb-b6ae-ca336279f4f6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:47.301550 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6d52a43c-0afa-41fb-b6ae-ca336279f4f6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:47.301962 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6d52a43c-0afa-41fb-b6ae-ca336279f4f6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:47.455080 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-6d52a43c-0afa-41fb-b6ae-ca336279f4f6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:47.463615 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-6d52a43c-0afa-41fb-b6ae-ca336279f4f6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f" status: 200 len: 1364 microversion: 2.1 time: 0.175740 Oct 11 12:03:47.464307 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 205/424] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:47 2022] GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:03:48.501967 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f8be713c-c27f-4bd8-bfe5-5c694cd02aec tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:48.502784 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f8be713c-c27f-4bd8-bfe5-5c694cd02aec tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 4fb48466-ddf3-47f7-bade-b20976690c7f] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:48.509725 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f8be713c-c27f-4bd8-bfe5-5c694cd02aec tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:48.510279 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f8be713c-c27f-4bd8-bfe5-5c694cd02aec tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:48.510675 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f8be713c-c27f-4bd8-bfe5-5c694cd02aec tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:48.511378 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f8be713c-c27f-4bd8-bfe5-5c694cd02aec tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:48.511825 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f8be713c-c27f-4bd8-bfe5-5c694cd02aec tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:48.512254 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f8be713c-c27f-4bd8-bfe5-5c694cd02aec tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:48.686723 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f8be713c-c27f-4bd8-bfe5-5c694cd02aec tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:48.695004 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f8be713c-c27f-4bd8-bfe5-5c694cd02aec tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f" status: 200 len: 1364 microversion: 2.1 time: 0.198097 Oct 11 12:03:48.695629 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 220/425] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:48 2022] GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f => generated 1364 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:49.719414 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-0a241d16-196e-4253-a2f1-e7086609a50f tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:49.720069 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-0a241d16-196e-4253-a2f1-e7086609a50f tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 4fb48466-ddf3-47f7-bade-b20976690c7f] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:49.726544 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0a241d16-196e-4253-a2f1-e7086609a50f tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:49.727061 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0a241d16-196e-4253-a2f1-e7086609a50f tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:49.727472 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0a241d16-196e-4253-a2f1-e7086609a50f tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:49.728188 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0a241d16-196e-4253-a2f1-e7086609a50f tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:49.728676 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0a241d16-196e-4253-a2f1-e7086609a50f tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:49.729052 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0a241d16-196e-4253-a2f1-e7086609a50f tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:49.874285 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-0a241d16-196e-4253-a2f1-e7086609a50f tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:49.882388 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-0a241d16-196e-4253-a2f1-e7086609a50f tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f" status: 200 len: 1364 microversion: 2.1 time: 0.167127 Oct 11 12:03:49.883018 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 206/426] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:49 2022] GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:50.907852 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-801a4d17-32b5-4046-8894-68c61a50e6b3 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:50.908472 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-801a4d17-32b5-4046-8894-68c61a50e6b3 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 4fb48466-ddf3-47f7-bade-b20976690c7f] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:50.915213 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-801a4d17-32b5-4046-8894-68c61a50e6b3 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:50.915702 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-801a4d17-32b5-4046-8894-68c61a50e6b3 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:50.916140 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-801a4d17-32b5-4046-8894-68c61a50e6b3 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:50.916865 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-801a4d17-32b5-4046-8894-68c61a50e6b3 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:50.917322 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-801a4d17-32b5-4046-8894-68c61a50e6b3 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:50.917753 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-801a4d17-32b5-4046-8894-68c61a50e6b3 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:51.144256 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-801a4d17-32b5-4046-8894-68c61a50e6b3 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:51.155716 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-801a4d17-32b5-4046-8894-68c61a50e6b3 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f" status: 200 len: 1364 microversion: 2.1 time: 0.251740 Oct 11 12:03:51.156423 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 221/427] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:50 2022] GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f => generated 1364 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:52.179136 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-afb7f645-03ca-4c72-85de-4f1842aab81d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:52.179806 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-afb7f645-03ca-4c72-85de-4f1842aab81d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 4fb48466-ddf3-47f7-bade-b20976690c7f] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:52.185905 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-afb7f645-03ca-4c72-85de-4f1842aab81d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:52.186450 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-afb7f645-03ca-4c72-85de-4f1842aab81d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:52.186897 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-afb7f645-03ca-4c72-85de-4f1842aab81d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:52.187590 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-afb7f645-03ca-4c72-85de-4f1842aab81d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:52.188033 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-afb7f645-03ca-4c72-85de-4f1842aab81d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:52.188459 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-afb7f645-03ca-4c72-85de-4f1842aab81d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:52.322945 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-afb7f645-03ca-4c72-85de-4f1842aab81d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:52.331141 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-afb7f645-03ca-4c72-85de-4f1842aab81d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f" status: 200 len: 1364 microversion: 2.1 time: 0.155934 Oct 11 12:03:52.331691 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 207/428] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:52 2022] GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:53.353772 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-093834f0-4084-45a1-ab30-c75dc2c2fa05 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:53.354368 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-093834f0-4084-45a1-ab30-c75dc2c2fa05 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 4fb48466-ddf3-47f7-bade-b20976690c7f] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:53.361735 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-093834f0-4084-45a1-ab30-c75dc2c2fa05 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:53.362231 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-093834f0-4084-45a1-ab30-c75dc2c2fa05 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:53.362693 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-093834f0-4084-45a1-ab30-c75dc2c2fa05 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:53.363419 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-093834f0-4084-45a1-ab30-c75dc2c2fa05 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:53.363865 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-093834f0-4084-45a1-ab30-c75dc2c2fa05 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:53.364279 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-093834f0-4084-45a1-ab30-c75dc2c2fa05 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:53.522125 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-093834f0-4084-45a1-ab30-c75dc2c2fa05 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:53.530782 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-093834f0-4084-45a1-ab30-c75dc2c2fa05 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f" status: 200 len: 1364 microversion: 2.1 time: 0.180924 Oct 11 12:03:53.531367 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 222/429] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:53 2022] GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f => generated 1364 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:54.257794 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-c4eb9de6-26dc-431a-a4b6-3f82afe76a21 req-b25f9994-5b80-43ef-87bf-29abc43f46ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fb48466-ddf3-47f7-bade-b20976690c7f", "name": "network-vif-plugged", "status": "completed", "tag": "69c4b54f-6212-491b-948d-48cf289c20da"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:03:54.262824 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell0:SELECT=6 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:03:54.268604 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-c4eb9de6-26dc-431a-a4b6-3f82afe76a21 req-b25f9994-5b80-43ef-87bf-29abc43f46ca service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:54.269042 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-c4eb9de6-26dc-431a-a4b6-3f82afe76a21 req-b25f9994-5b80-43ef-87bf-29abc43f46ca service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:54.269484 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-c4eb9de6-26dc-431a-a4b6-3f82afe76a21 req-b25f9994-5b80-43ef-87bf-29abc43f46ca service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:54.281501 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-c4eb9de6-26dc-431a-a4b6-3f82afe76a21 req-b25f9994-5b80-43ef-87bf-29abc43f46ca service nova] Creating event network-vif-plugged:69c4b54f-6212-491b-948d-48cf289c20da for instance 4fb48466-ddf3-47f7-bade-b20976690c7f on hv-cinder-82099 Oct 11 12:03:54.286735 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-c4eb9de6-26dc-431a-a4b6-3f82afe76a21 req-b25f9994-5b80-43ef-87bf-29abc43f46ca service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032592 Oct 11 12:03:54.287471 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 208/430] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:03:54.553576 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5c44f852-184c-4d9f-9526-10749ae49175 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:54.554380 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-5c44f852-184c-4d9f-9526-10749ae49175 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 4fb48466-ddf3-47f7-bade-b20976690c7f] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:54.556380 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=2 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:03:54.557094 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=6 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:03:54.564386 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5c44f852-184c-4d9f-9526-10749ae49175 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:54.564386 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5c44f852-184c-4d9f-9526-10749ae49175 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:54.564677 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5c44f852-184c-4d9f-9526-10749ae49175 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:54.565429 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5c44f852-184c-4d9f-9526-10749ae49175 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:54.565924 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5c44f852-184c-4d9f-9526-10749ae49175 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:54.566339 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5c44f852-184c-4d9f-9526-10749ae49175 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:54.729560 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5c44f852-184c-4d9f-9526-10749ae49175 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:54.738128 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5c44f852-184c-4d9f-9526-10749ae49175 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f" status: 200 len: 1364 microversion: 2.1 time: 0.188419 Oct 11 12:03:54.739001 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 223/431] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:54 2022] GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:55.766952 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-37e26823-a7c9-414a-84e0-1cf5be9d0c47 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:55.768249 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-37e26823-a7c9-414a-84e0-1cf5be9d0c47 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 4fb48466-ddf3-47f7-bade-b20976690c7f] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:55.779119 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-37e26823-a7c9-414a-84e0-1cf5be9d0c47 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:55.779692 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-37e26823-a7c9-414a-84e0-1cf5be9d0c47 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:55.780285 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-37e26823-a7c9-414a-84e0-1cf5be9d0c47 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:55.781083 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-37e26823-a7c9-414a-84e0-1cf5be9d0c47 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:55.781673 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-37e26823-a7c9-414a-84e0-1cf5be9d0c47 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:55.782143 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-37e26823-a7c9-414a-84e0-1cf5be9d0c47 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:55.932265 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-37e26823-a7c9-414a-84e0-1cf5be9d0c47 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:55.946545 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-37e26823-a7c9-414a-84e0-1cf5be9d0c47 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f" status: 200 len: 1364 microversion: 2.1 time: 0.187209 Oct 11 12:03:55.947370 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 209/432] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:55 2022] GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:56.972236 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7611eb88-d02b-47fe-a127-dc9ac83a30df tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:56.973042 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7611eb88-d02b-47fe-a127-dc9ac83a30df tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 4fb48466-ddf3-47f7-bade-b20976690c7f] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:56.980172 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7611eb88-d02b-47fe-a127-dc9ac83a30df tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:56.980748 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7611eb88-d02b-47fe-a127-dc9ac83a30df tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:56.981264 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7611eb88-d02b-47fe-a127-dc9ac83a30df tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:56.981953 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7611eb88-d02b-47fe-a127-dc9ac83a30df tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:56.982388 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7611eb88-d02b-47fe-a127-dc9ac83a30df tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:56.982822 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7611eb88-d02b-47fe-a127-dc9ac83a30df tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:57.169196 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7611eb88-d02b-47fe-a127-dc9ac83a30df tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:57.181995 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7611eb88-d02b-47fe-a127-dc9ac83a30df tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f" status: 200 len: 1364 microversion: 2.1 time: 0.213746 Oct 11 12:03:57.183095 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 224/433] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:56 2022] GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:03:58.217874 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-b9305bf6-6099-42e7-887f-66b493c74398 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:58.219386 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-b9305bf6-6099-42e7-887f-66b493c74398 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 4fb48466-ddf3-47f7-bade-b20976690c7f] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:58.227451 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b9305bf6-6099-42e7-887f-66b493c74398 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:58.228393 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b9305bf6-6099-42e7-887f-66b493c74398 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:58.229246 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b9305bf6-6099-42e7-887f-66b493c74398 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:58.230249 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b9305bf6-6099-42e7-887f-66b493c74398 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:58.230985 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b9305bf6-6099-42e7-887f-66b493c74398 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:58.231641 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b9305bf6-6099-42e7-887f-66b493c74398 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:58.376918 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-b9305bf6-6099-42e7-887f-66b493c74398 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:03:58.385025 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-b9305bf6-6099-42e7-887f-66b493c74398 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f" status: 200 len: 1555 microversion: 2.1 time: 0.171195 Oct 11 12:03:58.385646 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 210/434] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:03:58 2022] GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:03:58.408792 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8901c83a-b9b2-4308-b085-010d88bef979 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:03:58.409546 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8901c83a-b9b2-4308-b085-010d88bef979 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 4fb48466-ddf3-47f7-bade-b20976690c7f] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:03:58.418035 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8901c83a-b9b2-4308-b085-010d88bef979 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:58.418615 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8901c83a-b9b2-4308-b085-010d88bef979 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:58.419857 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8901c83a-b9b2-4308-b085-010d88bef979 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:58.420786 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8901c83a-b9b2-4308-b085-010d88bef979 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:03:58.421236 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8901c83a-b9b2-4308-b085-010d88bef979 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:03:58.421672 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8901c83a-b9b2-4308-b085-010d88bef979 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:03:58.509152 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8901c83a-b9b2-4308-b085-010d88bef979 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104699 Oct 11 12:03:58.509843 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 225/435] 10.222.0.59 () {58 vars in 1275 bytes} [Tue Oct 11 12:03:58 2022] GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:04:00.015318 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-2041af61-1cf3-498c-9867-9966e2ea2de0 req-74c41348-925e-4850-a3e5-fa211485ad52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fb48466-ddf3-47f7-bade-b20976690c7f", "tag": "69c4b54f-6212-491b-948d-48cf289c20da"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:04:00.026217 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-2041af61-1cf3-498c-9867-9966e2ea2de0 req-74c41348-925e-4850-a3e5-fa211485ad52 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:00.026900 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-2041af61-1cf3-498c-9867-9966e2ea2de0 req-74c41348-925e-4850-a3e5-fa211485ad52 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:00.027342 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-2041af61-1cf3-498c-9867-9966e2ea2de0 req-74c41348-925e-4850-a3e5-fa211485ad52 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:00.040799 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-2041af61-1cf3-498c-9867-9966e2ea2de0 req-74c41348-925e-4850-a3e5-fa211485ad52 service nova] Creating event network-changed:69c4b54f-6212-491b-948d-48cf289c20da for instance 4fb48466-ddf3-47f7-bade-b20976690c7f on hv-cinder-82099 Oct 11 12:04:00.047370 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-2041af61-1cf3-498c-9867-9966e2ea2de0 req-74c41348-925e-4850-a3e5-fa211485ad52 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035898 Oct 11 12:04:00.047980 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 211/436] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:04:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:04:21.960477 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:04:21.961734 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=43 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:04:21.968739 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-31e834f2-281e-4542-9f52-094cc0244259 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1337142067", "imageRef": "09bcc8f8-a32f-4ec8-9ab2-a98964ad6a01", "flavorRef": "452", "networks": [{"uuid": "f052a03b-9e17-4e41-b7c3-9530b5963021"}]}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:04:22.042466 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.network.neutron [None req-31e834f2-281e-4542-9f52-094cc0244259 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] validate_networks() for [('f052a03b-9e17-4e41-b7c3-9530b5963021', None, None, None, None, None)] {{(pid=118995) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 12:04:22.417077 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-31e834f2-281e-4542-9f52-094cc0244259 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Flavor limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 12:04:22.418044 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-31e834f2-281e-4542-9f52-094cc0244259 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Image limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 12:04:22.418788 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-31e834f2-281e-4542-9f52-094cc0244259 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Flavor pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 12:04:22.419226 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-31e834f2-281e-4542-9f52-094cc0244259 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Image pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 12:04:22.419810 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-31e834f2-281e-4542-9f52-094cc0244259 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 12:04:22.433189 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-31e834f2-281e-4542-9f52-094cc0244259 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:22.433740 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-31e834f2-281e-4542-9f52-094cc0244259 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:22.434296 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-31e834f2-281e-4542-9f52-094cc0244259 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:22.435485 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-31e834f2-281e-4542-9f52-094cc0244259 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:22.436158 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-31e834f2-281e-4542-9f52-094cc0244259 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:22.436713 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-31e834f2-281e-4542-9f52-094cc0244259 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:22.454696 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-31e834f2-281e-4542-9f52-094cc0244259 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Getting quotas for project 8908fef147b141b088ec5d458112e624. Resources: {'ram', 'instances', 'cores'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 12:04:22.458746 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-31e834f2-281e-4542-9f52-094cc0244259 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Getting quotas for user e4e098a260b94b2089801f02bdb0b126 and project 8908fef147b141b088ec5d458112e624. Resources: {'ram', 'instances', 'cores'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 12:04:22.470632 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-31e834f2-281e-4542-9f52-094cc0244259 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Going to run 1 instances... {{(pid=118995) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 12:04:22.472990 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-31e834f2-281e-4542-9f52-094cc0244259 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 9c9bc278-9d35-4a42-b77f-579500fbdc0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09bcc8f8-a32f-4ec8-9ab2-a98964ad6a01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118995) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 12:04:22.522507 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-31e834f2-281e-4542-9f52-094cc0244259 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564842 Oct 11 12:04:22.523707 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 226/437] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Oct 11 12:04:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 567 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 12:04:22.534278 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:04:22.535090 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=40 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:04:22.539617 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-4b46d12f-a206-42c4-8c71-0c8f28a764ec tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:04:22.540315 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-4b46d12f-a206-42c4-8c71-0c8f28a764ec tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 9c9bc278-9d35-4a42-b77f-579500fbdc0b] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:04:22.605145 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-4b46d12f-a206-42c4-8c71-0c8f28a764ec tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:04:22.613408 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-4b46d12f-a206-42c4-8c71-0c8f28a764ec tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b" status: 200 len: 1219 microversion: 2.1 time: 0.080230 Oct 11 12:04:22.613996 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 212/438] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:04:22 2022] GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:04:23.638071 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f91adb34-72d1-43ba-bc69-569261755427 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:04:23.638665 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f91adb34-72d1-43ba-bc69-569261755427 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 9c9bc278-9d35-4a42-b77f-579500fbdc0b] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:04:23.645368 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f91adb34-72d1-43ba-bc69-569261755427 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:23.645861 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f91adb34-72d1-43ba-bc69-569261755427 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:23.646291 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f91adb34-72d1-43ba-bc69-569261755427 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:23.647044 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f91adb34-72d1-43ba-bc69-569261755427 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:23.647501 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f91adb34-72d1-43ba-bc69-569261755427 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:23.647899 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f91adb34-72d1-43ba-bc69-569261755427 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:23.713345 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f91adb34-72d1-43ba-bc69-569261755427 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:04:23.721878 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f91adb34-72d1-43ba-bc69-569261755427 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b" status: 200 len: 1271 microversion: 2.1 time: 0.088304 Oct 11 12:04:23.722485 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 227/439] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:04:23 2022] GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b => generated 1271 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:04:24.745458 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-279019fc-9677-4ec5-a11d-f6424be71f01 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:04:24.746135 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-279019fc-9677-4ec5-a11d-f6424be71f01 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 9c9bc278-9d35-4a42-b77f-579500fbdc0b] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:04:24.752350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-279019fc-9677-4ec5-a11d-f6424be71f01 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:24.752824 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-279019fc-9677-4ec5-a11d-f6424be71f01 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:24.753237 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-279019fc-9677-4ec5-a11d-f6424be71f01 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:24.753921 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-279019fc-9677-4ec5-a11d-f6424be71f01 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:24.754373 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-279019fc-9677-4ec5-a11d-f6424be71f01 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:24.754798 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-279019fc-9677-4ec5-a11d-f6424be71f01 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:24.911877 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-279019fc-9677-4ec5-a11d-f6424be71f01 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:04:24.925317 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-279019fc-9677-4ec5-a11d-f6424be71f01 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b" status: 200 len: 1319 microversion: 2.1 time: 0.183600 Oct 11 12:04:24.926624 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 213/440] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:04:24 2022] GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:04:25.553551 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-361eb3d8-85a8-400d-bf04-4f7e9003e409 req-d14d066f-666e-43ef-a14e-396e2d8542fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c9bc278-9d35-4a42-b77f-579500fbdc0b", "tag": "2dac5a27-b37e-49f8-b3e7-c0e108ff36e9"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:04:25.564741 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-361eb3d8-85a8-400d-bf04-4f7e9003e409 req-d14d066f-666e-43ef-a14e-396e2d8542fe service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:25.565270 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-361eb3d8-85a8-400d-bf04-4f7e9003e409 req-d14d066f-666e-43ef-a14e-396e2d8542fe service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:25.565701 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-361eb3d8-85a8-400d-bf04-4f7e9003e409 req-d14d066f-666e-43ef-a14e-396e2d8542fe service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:25.579349 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-361eb3d8-85a8-400d-bf04-4f7e9003e409 req-d14d066f-666e-43ef-a14e-396e2d8542fe service nova] Creating event network-changed:2dac5a27-b37e-49f8-b3e7-c0e108ff36e9 for instance 9c9bc278-9d35-4a42-b77f-579500fbdc0b on hv-cinder-82099 Oct 11 12:04:25.584884 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-361eb3d8-85a8-400d-bf04-4f7e9003e409 req-d14d066f-666e-43ef-a14e-396e2d8542fe service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035121 Oct 11 12:04:25.585943 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 228/441] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:04:25.949470 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-a5baa8a6-13f3-4f47-9cd4-af5b88082b8e tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:04:25.950032 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-a5baa8a6-13f3-4f47-9cd4-af5b88082b8e tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 9c9bc278-9d35-4a42-b77f-579500fbdc0b] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:04:25.956278 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a5baa8a6-13f3-4f47-9cd4-af5b88082b8e tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:25.956763 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a5baa8a6-13f3-4f47-9cd4-af5b88082b8e tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:25.957191 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a5baa8a6-13f3-4f47-9cd4-af5b88082b8e tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:25.957879 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a5baa8a6-13f3-4f47-9cd4-af5b88082b8e tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:25.958332 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a5baa8a6-13f3-4f47-9cd4-af5b88082b8e tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:25.958769 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a5baa8a6-13f3-4f47-9cd4-af5b88082b8e tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:26.101250 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-a5baa8a6-13f3-4f47-9cd4-af5b88082b8e tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:04:26.109456 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-a5baa8a6-13f3-4f47-9cd4-af5b88082b8e tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b" status: 200 len: 1319 microversion: 2.1 time: 0.163968 Oct 11 12:04:26.110031 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 214/442] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:04:25 2022] GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:04:27.140682 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b6b0d195-675c-47c4-972b-9c0529dc26f8 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:04:27.141351 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-b6b0d195-675c-47c4-972b-9c0529dc26f8 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 9c9bc278-9d35-4a42-b77f-579500fbdc0b] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:04:27.149186 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b6b0d195-675c-47c4-972b-9c0529dc26f8 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:27.149665 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b6b0d195-675c-47c4-972b-9c0529dc26f8 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:27.150083 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b6b0d195-675c-47c4-972b-9c0529dc26f8 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:27.150817 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b6b0d195-675c-47c4-972b-9c0529dc26f8 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:27.151279 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b6b0d195-675c-47c4-972b-9c0529dc26f8 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:27.151700 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b6b0d195-675c-47c4-972b-9c0529dc26f8 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:27.298210 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-b6b0d195-675c-47c4-972b-9c0529dc26f8 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:04:27.307065 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b6b0d195-675c-47c4-972b-9c0529dc26f8 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b" status: 200 len: 1319 microversion: 2.1 time: 0.171592 Oct 11 12:04:27.307656 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 229/443] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:04:27 2022] GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:04:28.330018 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-369cd5bc-0fb1-455d-a0c3-2eaeb60011e8 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:04:28.330767 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-369cd5bc-0fb1-455d-a0c3-2eaeb60011e8 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 9c9bc278-9d35-4a42-b77f-579500fbdc0b] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:04:28.337252 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-369cd5bc-0fb1-455d-a0c3-2eaeb60011e8 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:28.337729 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-369cd5bc-0fb1-455d-a0c3-2eaeb60011e8 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:28.338437 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-369cd5bc-0fb1-455d-a0c3-2eaeb60011e8 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:28.339144 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-369cd5bc-0fb1-455d-a0c3-2eaeb60011e8 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:28.339642 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-369cd5bc-0fb1-455d-a0c3-2eaeb60011e8 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:28.340056 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-369cd5bc-0fb1-455d-a0c3-2eaeb60011e8 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:28.475230 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-369cd5bc-0fb1-455d-a0c3-2eaeb60011e8 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:04:28.487279 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-369cd5bc-0fb1-455d-a0c3-2eaeb60011e8 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b" status: 200 len: 1319 microversion: 2.1 time: 0.160887 Oct 11 12:04:28.488108 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 215/444] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:04:28 2022] GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:04:29.515553 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-dbaa0ce1-5240-4f3e-9334-fbdf248f8ca3 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:04:29.516125 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-dbaa0ce1-5240-4f3e-9334-fbdf248f8ca3 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 9c9bc278-9d35-4a42-b77f-579500fbdc0b] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:04:29.523453 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dbaa0ce1-5240-4f3e-9334-fbdf248f8ca3 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:29.523935 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dbaa0ce1-5240-4f3e-9334-fbdf248f8ca3 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:29.524375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dbaa0ce1-5240-4f3e-9334-fbdf248f8ca3 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:29.525052 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dbaa0ce1-5240-4f3e-9334-fbdf248f8ca3 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:29.525497 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dbaa0ce1-5240-4f3e-9334-fbdf248f8ca3 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:29.525913 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dbaa0ce1-5240-4f3e-9334-fbdf248f8ca3 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:29.668621 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-dbaa0ce1-5240-4f3e-9334-fbdf248f8ca3 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:04:29.676720 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-dbaa0ce1-5240-4f3e-9334-fbdf248f8ca3 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b" status: 200 len: 1319 microversion: 2.1 time: 0.165111 Oct 11 12:04:29.677298 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 230/445] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:04:29 2022] GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:04:30.701331 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-539ab78e-6c9d-469d-bb1c-cc3f97db9024 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:04:30.701915 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-539ab78e-6c9d-469d-bb1c-cc3f97db9024 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 9c9bc278-9d35-4a42-b77f-579500fbdc0b] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:04:30.708398 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-539ab78e-6c9d-469d-bb1c-cc3f97db9024 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:30.708876 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-539ab78e-6c9d-469d-bb1c-cc3f97db9024 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:30.709298 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-539ab78e-6c9d-469d-bb1c-cc3f97db9024 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:30.710171 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-539ab78e-6c9d-469d-bb1c-cc3f97db9024 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:30.710684 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-539ab78e-6c9d-469d-bb1c-cc3f97db9024 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:30.711279 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-539ab78e-6c9d-469d-bb1c-cc3f97db9024 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:30.861941 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-539ab78e-6c9d-469d-bb1c-cc3f97db9024 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:04:30.874299 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-539ab78e-6c9d-469d-bb1c-cc3f97db9024 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b" status: 200 len: 1319 microversion: 2.1 time: 0.176907 Oct 11 12:04:30.874934 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 216/446] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:04:30 2022] GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:04:31.898685 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8f307877-5fde-4d3e-819d-c98723b336b7 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:04:31.899496 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8f307877-5fde-4d3e-819d-c98723b336b7 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 9c9bc278-9d35-4a42-b77f-579500fbdc0b] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:04:31.906672 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8f307877-5fde-4d3e-819d-c98723b336b7 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:31.907160 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8f307877-5fde-4d3e-819d-c98723b336b7 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:31.907589 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8f307877-5fde-4d3e-819d-c98723b336b7 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:31.908285 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8f307877-5fde-4d3e-819d-c98723b336b7 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:31.908731 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8f307877-5fde-4d3e-819d-c98723b336b7 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:31.909152 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8f307877-5fde-4d3e-819d-c98723b336b7 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:32.049517 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8f307877-5fde-4d3e-819d-c98723b336b7 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:04:32.057514 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8f307877-5fde-4d3e-819d-c98723b336b7 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b" status: 200 len: 1319 microversion: 2.1 time: 0.163475 Oct 11 12:04:32.058102 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 231/447] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:04:31 2022] GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:04:32.396801 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-2db62e7e-c507-44dd-9574-915cba13d353 req-6429d151-ffbf-46b6-8c1b-d7f10fdfd36f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c9bc278-9d35-4a42-b77f-579500fbdc0b", "name": "network-vif-plugged", "status": "completed", "tag": "2dac5a27-b37e-49f8-b3e7-c0e108ff36e9"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:04:32.411606 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-2db62e7e-c507-44dd-9574-915cba13d353 req-6429d151-ffbf-46b6-8c1b-d7f10fdfd36f service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:32.412395 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-2db62e7e-c507-44dd-9574-915cba13d353 req-6429d151-ffbf-46b6-8c1b-d7f10fdfd36f service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:32.413021 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-2db62e7e-c507-44dd-9574-915cba13d353 req-6429d151-ffbf-46b6-8c1b-d7f10fdfd36f service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:32.425393 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-2db62e7e-c507-44dd-9574-915cba13d353 req-6429d151-ffbf-46b6-8c1b-d7f10fdfd36f service nova] Creating event network-vif-plugged:2dac5a27-b37e-49f8-b3e7-c0e108ff36e9 for instance 9c9bc278-9d35-4a42-b77f-579500fbdc0b on hv-cinder-82099 Oct 11 12:04:32.430641 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-2db62e7e-c507-44dd-9574-915cba13d353 req-6429d151-ffbf-46b6-8c1b-d7f10fdfd36f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039580 Oct 11 12:04:32.431523 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 217/448] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:04:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:04:33.082322 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ef155b6e-fbbb-40ab-8f56-57dbe8e42c5b tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:04:33.083052 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ef155b6e-fbbb-40ab-8f56-57dbe8e42c5b tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 9c9bc278-9d35-4a42-b77f-579500fbdc0b] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:04:33.084936 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=2 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:04:33.085603 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=6 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:04:33.092560 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ef155b6e-fbbb-40ab-8f56-57dbe8e42c5b tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:33.093047 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ef155b6e-fbbb-40ab-8f56-57dbe8e42c5b tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:33.093479 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ef155b6e-fbbb-40ab-8f56-57dbe8e42c5b tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:33.094182 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ef155b6e-fbbb-40ab-8f56-57dbe8e42c5b tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:33.094668 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ef155b6e-fbbb-40ab-8f56-57dbe8e42c5b tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:33.095094 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ef155b6e-fbbb-40ab-8f56-57dbe8e42c5b tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:33.240922 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ef155b6e-fbbb-40ab-8f56-57dbe8e42c5b tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:04:33.249042 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ef155b6e-fbbb-40ab-8f56-57dbe8e42c5b tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b" status: 200 len: 1319 microversion: 2.1 time: 0.170630 Oct 11 12:04:33.249615 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 232/449] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:04:33 2022] GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:04:34.284799 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell0:SELECT=2 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:04:34.288985 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-03e45f5e-f872-4ed5-bdfb-d918729c5b76 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:04:34.289671 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-03e45f5e-f872-4ed5-bdfb-d918729c5b76 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 9c9bc278-9d35-4a42-b77f-579500fbdc0b] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:04:34.296112 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-03e45f5e-f872-4ed5-bdfb-d918729c5b76 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:34.296575 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-03e45f5e-f872-4ed5-bdfb-d918729c5b76 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:34.296996 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-03e45f5e-f872-4ed5-bdfb-d918729c5b76 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:34.297664 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-03e45f5e-f872-4ed5-bdfb-d918729c5b76 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:34.298099 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-03e45f5e-f872-4ed5-bdfb-d918729c5b76 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:34.298510 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-03e45f5e-f872-4ed5-bdfb-d918729c5b76 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:34.436760 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-03e45f5e-f872-4ed5-bdfb-d918729c5b76 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:04:34.444848 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-03e45f5e-f872-4ed5-bdfb-d918729c5b76 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b" status: 200 len: 1319 microversion: 2.1 time: 0.161172 Oct 11 12:04:34.445423 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 218/450] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:04:34 2022] GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:04:35.470125 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5c2f80fa-ef1c-4fcf-aed4-a06f0803c63e tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:04:35.470939 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-5c2f80fa-ef1c-4fcf-aed4-a06f0803c63e tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 9c9bc278-9d35-4a42-b77f-579500fbdc0b] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:04:35.478905 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5c2f80fa-ef1c-4fcf-aed4-a06f0803c63e tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:35.479385 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5c2f80fa-ef1c-4fcf-aed4-a06f0803c63e tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:35.479811 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5c2f80fa-ef1c-4fcf-aed4-a06f0803c63e tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:35.480502 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5c2f80fa-ef1c-4fcf-aed4-a06f0803c63e tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:35.480950 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5c2f80fa-ef1c-4fcf-aed4-a06f0803c63e tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:35.481366 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5c2f80fa-ef1c-4fcf-aed4-a06f0803c63e tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:35.616387 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5c2f80fa-ef1c-4fcf-aed4-a06f0803c63e tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:04:35.626769 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5c2f80fa-ef1c-4fcf-aed4-a06f0803c63e tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b" status: 200 len: 1507 microversion: 2.1 time: 0.161348 Oct 11 12:04:35.627416 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 233/451] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:04:35 2022] GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:04:40.482388 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-3b892f2d-8d62-4f3c-a363-a32407353ac1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:04:40.483029 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-3b892f2d-8d62-4f3c-a363-a32407353ac1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:04:40.489274 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3b892f2d-8d62-4f3c-a363-a32407353ac1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:40.489755 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3b892f2d-8d62-4f3c-a363-a32407353ac1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:40.490184 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3b892f2d-8d62-4f3c-a363-a32407353ac1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:40.490990 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3b892f2d-8d62-4f3c-a363-a32407353ac1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:40.491504 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3b892f2d-8d62-4f3c-a363-a32407353ac1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:40.491912 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3b892f2d-8d62-4f3c-a363-a32407353ac1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:40.517527 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-3b892f2d-8d62-4f3c-a363-a32407353ac1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91/ips" status: 200 len: 146 microversion: 2.1 time: 0.038981 Oct 11 12:04:40.518095 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 219/452] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Oct 11 12:04:40 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:04:42.804378 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c09050be-734e-4739-bb85-d977a7a1a163 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "959fac13-c58a-4173-adbc-bc8a4a6367de"}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:04:42.807059 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c09050be-734e-4739-bb85-d977a7a1a163 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:04:42.814220 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c09050be-734e-4739-bb85-d977a7a1a163 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:42.814754 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c09050be-734e-4739-bb85-d977a7a1a163 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:42.815148 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c09050be-734e-4739-bb85-d977a7a1a163 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:42.815848 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c09050be-734e-4739-bb85-d977a7a1a163 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:42.816302 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c09050be-734e-4739-bb85-d977a7a1a163 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:42.816720 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c09050be-734e-4739-bb85-d977a7a1a163 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:43.130437 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c09050be-734e-4739-bb85-d977a7a1a163 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "POST /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.329673 Oct 11 12:04:43.131081 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 234/453] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Oct 11 12:04:42 2022] POST /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91/os-volume_attachments => generated 194 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:04:49.302480 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-04f83297-ead3-4957-a8b7-2f6eda60d8ba tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "476dd514-0fa6-410a-b047-2fe7446ba84e"}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:04:49.304890 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-04f83297-ead3-4957-a8b7-2f6eda60d8ba tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:04:49.311360 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-04f83297-ead3-4957-a8b7-2f6eda60d8ba tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:49.311841 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-04f83297-ead3-4957-a8b7-2f6eda60d8ba tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:49.312279 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-04f83297-ead3-4957-a8b7-2f6eda60d8ba tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:49.312983 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-04f83297-ead3-4957-a8b7-2f6eda60d8ba tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:49.313441 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-04f83297-ead3-4957-a8b7-2f6eda60d8ba tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:49.313857 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-04f83297-ead3-4957-a8b7-2f6eda60d8ba tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:54.840294 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=43 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:04:55.111077 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-04f83297-ead3-4957-a8b7-2f6eda60d8ba tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "POST /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.812472 Oct 11 12:04:55.111692 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 220/454] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Oct 11 12:04:49 2022] POST /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa/os-volume_attachments => generated 194 bytes in 5814 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:04:56.071624 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3a3c9a26-1419-4ad6-8df3-40fb9b1ba5fd tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:04:56.074680 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:04:56.075481 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:04:56.082498 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3a3c9a26-1419-4ad6-8df3-40fb9b1ba5fd tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:56.083018 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3a3c9a26-1419-4ad6-8df3-40fb9b1ba5fd tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:56.083450 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3a3c9a26-1419-4ad6-8df3-40fb9b1ba5fd tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:56.148786 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-3a3c9a26-1419-4ad6-8df3-40fb9b1ba5fd tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Going to try to stop instance {{(pid=118995) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 12:04:56.197216 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-3a3c9a26-1419-4ad6-8df3-40fb9b1ba5fd tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "POST /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91/action" status: 202 len: 0 microversion: 2.1 time: 0.131925 Oct 11 12:04:56.200862 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 235/455] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Oct 11 12:04:56 2022] POST /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 12:04:56.208969 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-c9097c9b-15e8-401d-9160-644a5148b5d1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:04:56.209679 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-c9097c9b-15e8-401d-9160-644a5148b5d1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:04:56.222331 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_api:SELECT=21 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:04:56.228435 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c9097c9b-15e8-401d-9160-644a5148b5d1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:56.228933 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c9097c9b-15e8-401d-9160-644a5148b5d1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:56.229454 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c9097c9b-15e8-401d-9160-644a5148b5d1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:56.230192 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c9097c9b-15e8-401d-9160-644a5148b5d1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:56.230686 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c9097c9b-15e8-401d-9160-644a5148b5d1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:56.231069 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c9097c9b-15e8-401d-9160-644a5148b5d1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:56.376682 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-c9097c9b-15e8-401d-9160-644a5148b5d1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:04:56.388438 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-c9097c9b-15e8-401d-9160-644a5148b5d1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1724 microversion: 2.1 time: 0.185427 Oct 11 12:04:56.389147 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 221/456] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:04:56 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:04:57.414594 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-52a8e57f-a7b7-4ae1-8df3-c13dba3fe7dc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:04:57.415473 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-52a8e57f-a7b7-4ae1-8df3-c13dba3fe7dc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:04:57.423102 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-52a8e57f-a7b7-4ae1-8df3-c13dba3fe7dc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:57.423598 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-52a8e57f-a7b7-4ae1-8df3-c13dba3fe7dc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:57.424029 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-52a8e57f-a7b7-4ae1-8df3-c13dba3fe7dc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:57.424726 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-52a8e57f-a7b7-4ae1-8df3-c13dba3fe7dc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:57.425182 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-52a8e57f-a7b7-4ae1-8df3-c13dba3fe7dc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:57.425587 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-52a8e57f-a7b7-4ae1-8df3-c13dba3fe7dc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:57.628856 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-52a8e57f-a7b7-4ae1-8df3-c13dba3fe7dc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:04:57.643546 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-52a8e57f-a7b7-4ae1-8df3-c13dba3fe7dc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1724 microversion: 2.1 time: 0.233729 Oct 11 12:04:57.644147 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 236/457] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:04:57 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:04:58.668295 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-2fc46433-3cea-409a-bcab-0e066003da78 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:04:58.668884 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-2fc46433-3cea-409a-bcab-0e066003da78 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:04:58.675805 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2fc46433-3cea-409a-bcab-0e066003da78 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:58.676291 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2fc46433-3cea-409a-bcab-0e066003da78 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:58.676721 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2fc46433-3cea-409a-bcab-0e066003da78 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:58.677401 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2fc46433-3cea-409a-bcab-0e066003da78 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:58.677846 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2fc46433-3cea-409a-bcab-0e066003da78 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:58.678288 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2fc46433-3cea-409a-bcab-0e066003da78 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:58.815997 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-2fc46433-3cea-409a-bcab-0e066003da78 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:04:58.824922 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-2fc46433-3cea-409a-bcab-0e066003da78 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1724 microversion: 2.1 time: 0.160556 Oct 11 12:04:58.825503 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 222/458] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:04:58 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:04:59.848299 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c355e3db-4971-4f39-ba5e-1127e3a7d013 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:04:59.848936 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c355e3db-4971-4f39-ba5e-1127e3a7d013 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:04:59.855759 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c355e3db-4971-4f39-ba5e-1127e3a7d013 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:59.856247 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c355e3db-4971-4f39-ba5e-1127e3a7d013 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:59.856687 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c355e3db-4971-4f39-ba5e-1127e3a7d013 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:04:59.857408 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c355e3db-4971-4f39-ba5e-1127e3a7d013 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:04:59.857858 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c355e3db-4971-4f39-ba5e-1127e3a7d013 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:04:59.858280 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c355e3db-4971-4f39-ba5e-1127e3a7d013 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:00.001598 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c355e3db-4971-4f39-ba5e-1127e3a7d013 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:00.010723 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c355e3db-4971-4f39-ba5e-1127e3a7d013 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1724 microversion: 2.1 time: 0.166271 Oct 11 12:05:00.011292 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 237/459] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:04:59 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:00.502096 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-4ea92e22-89d3-4374-b038-e5b64286c1a0 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8853a806-7092-4ee6-b0ec-8797085c117a", "device": "/dev/sdb"}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:05:00.505194 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-4ea92e22-89d3-4374-b038-e5b64286c1a0 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 9c9bc278-9d35-4a42-b77f-579500fbdc0b] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:00.512090 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4ea92e22-89d3-4374-b038-e5b64286c1a0 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:00.512571 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4ea92e22-89d3-4374-b038-e5b64286c1a0 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:00.513027 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4ea92e22-89d3-4374-b038-e5b64286c1a0 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:00.513743 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4ea92e22-89d3-4374-b038-e5b64286c1a0 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:00.514184 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4ea92e22-89d3-4374-b038-e5b64286c1a0 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:00.514628 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4ea92e22-89d3-4374-b038-e5b64286c1a0 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:00.827407 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-4ea92e22-89d3-4374-b038-e5b64286c1a0 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "POST /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.328586 Oct 11 12:05:00.828111 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 223/460] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Oct 11 12:05:00 2022] POST /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b/os-volume_attachments => generated 194 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:05:01.036681 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c98beb39-9bb3-43d1-952c-fe3ff5c0c3da tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:01.037247 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c98beb39-9bb3-43d1-952c-fe3ff5c0c3da tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:01.043870 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c98beb39-9bb3-43d1-952c-fe3ff5c0c3da tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:01.044355 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c98beb39-9bb3-43d1-952c-fe3ff5c0c3da tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:01.044787 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c98beb39-9bb3-43d1-952c-fe3ff5c0c3da tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:01.045466 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c98beb39-9bb3-43d1-952c-fe3ff5c0c3da tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:01.045909 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c98beb39-9bb3-43d1-952c-fe3ff5c0c3da tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:01.046326 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c98beb39-9bb3-43d1-952c-fe3ff5c0c3da tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:01.192522 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c98beb39-9bb3-43d1-952c-fe3ff5c0c3da tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:01.201789 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c98beb39-9bb3-43d1-952c-fe3ff5c0c3da tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1724 microversion: 2.1 time: 0.169126 Oct 11 12:05:01.202717 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 238/461] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:01 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:02.229929 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-05e0a4e4-8d72-4a0f-a7f1-3f687abe1e8b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:02.230655 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-05e0a4e4-8d72-4a0f-a7f1-3f687abe1e8b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:02.237383 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-05e0a4e4-8d72-4a0f-a7f1-3f687abe1e8b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:02.237899 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-05e0a4e4-8d72-4a0f-a7f1-3f687abe1e8b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:02.238297 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-05e0a4e4-8d72-4a0f-a7f1-3f687abe1e8b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:02.239065 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-05e0a4e4-8d72-4a0f-a7f1-3f687abe1e8b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:02.239514 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-05e0a4e4-8d72-4a0f-a7f1-3f687abe1e8b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:02.239936 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-05e0a4e4-8d72-4a0f-a7f1-3f687abe1e8b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:02.389200 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-05e0a4e4-8d72-4a0f-a7f1-3f687abe1e8b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:02.399052 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-05e0a4e4-8d72-4a0f-a7f1-3f687abe1e8b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1724 microversion: 2.1 time: 0.175930 Oct 11 12:05:02.399662 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 224/462] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:02 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:02.736934 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5e665fbf-d793-4f9a-a343-e27be9b36a2e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:05:02.739733 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-5e665fbf-d793-4f9a-a343-e27be9b36a2e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:02.746543 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5e665fbf-d793-4f9a-a343-e27be9b36a2e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:02.747061 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5e665fbf-d793-4f9a-a343-e27be9b36a2e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:02.747496 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5e665fbf-d793-4f9a-a343-e27be9b36a2e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:02.748201 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5e665fbf-d793-4f9a-a343-e27be9b36a2e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:02.748651 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5e665fbf-d793-4f9a-a343-e27be9b36a2e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:02.749069 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5e665fbf-d793-4f9a-a343-e27be9b36a2e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:02.775188 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-5e665fbf-d793-4f9a-a343-e27be9b36a2e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lazy-loading 'flavor' on Instance uuid 1be649cc-66ab-45f6-8477-19a7263944fa {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:05:02.946313 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5e665fbf-d793-4f9a-a343-e27be9b36a2e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "POST /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa/action" status: 200 len: 32 microversion: 2.1 time: 0.213204 Oct 11 12:05:02.947103 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 239/463] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Oct 11 12:05:02 2022] POST /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa/action => generated 32 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 12:05:02.961321 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-d929f6c1-2506-4099-9059-21a8efd7f6d7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:02.961321 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-d929f6c1-2506-4099-9059-21a8efd7f6d7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:02.967590 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d929f6c1-2506-4099-9059-21a8efd7f6d7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:02.968096 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d929f6c1-2506-4099-9059-21a8efd7f6d7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:02.968529 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d929f6c1-2506-4099-9059-21a8efd7f6d7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:02.969286 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d929f6c1-2506-4099-9059-21a8efd7f6d7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:02.970903 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d929f6c1-2506-4099-9059-21a8efd7f6d7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:02.970903 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d929f6c1-2506-4099-9059-21a8efd7f6d7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:03.127707 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-d929f6c1-2506-4099-9059-21a8efd7f6d7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:03.138393 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-d929f6c1-2506-4099-9059-21a8efd7f6d7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1735 microversion: 2.1 time: 0.184571 Oct 11 12:05:03.139513 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 225/464] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:02 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:03.424824 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8c7b16ca-b788-4344-98b1-2bf562791e0b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:03.425788 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8c7b16ca-b788-4344-98b1-2bf562791e0b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:03.432591 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8c7b16ca-b788-4344-98b1-2bf562791e0b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:03.433142 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8c7b16ca-b788-4344-98b1-2bf562791e0b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:03.433515 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8c7b16ca-b788-4344-98b1-2bf562791e0b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:03.434404 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8c7b16ca-b788-4344-98b1-2bf562791e0b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:03.434962 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8c7b16ca-b788-4344-98b1-2bf562791e0b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:03.435340 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8c7b16ca-b788-4344-98b1-2bf562791e0b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:03.657353 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8c7b16ca-b788-4344-98b1-2bf562791e0b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:03.670209 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8c7b16ca-b788-4344-98b1-2bf562791e0b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1724 microversion: 2.1 time: 0.250211 Oct 11 12:05:03.670865 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 240/465] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:03 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:04.162817 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-5effb34e-4452-4e78-ab30-2b43ef2d8615 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:04.163334 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-5effb34e-4452-4e78-ab30-2b43ef2d8615 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:04.171298 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5effb34e-4452-4e78-ab30-2b43ef2d8615 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:04.171786 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5effb34e-4452-4e78-ab30-2b43ef2d8615 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:04.172216 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5effb34e-4452-4e78-ab30-2b43ef2d8615 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:04.172911 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5effb34e-4452-4e78-ab30-2b43ef2d8615 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:04.173359 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5effb34e-4452-4e78-ab30-2b43ef2d8615 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:04.173778 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5effb34e-4452-4e78-ab30-2b43ef2d8615 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:04.327550 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-5effb34e-4452-4e78-ab30-2b43ef2d8615 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:04.336342 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-5effb34e-4452-4e78-ab30-2b43ef2d8615 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1735 microversion: 2.1 time: 0.177511 Oct 11 12:05:04.336921 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 226/466] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:04 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1735 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:04.695038 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-089d2558-3337-4489-b9b7-5a5ea18a7bbc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:04.695703 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-089d2558-3337-4489-b9b7-5a5ea18a7bbc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:04.703193 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-089d2558-3337-4489-b9b7-5a5ea18a7bbc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:04.703674 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-089d2558-3337-4489-b9b7-5a5ea18a7bbc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:04.704101 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-089d2558-3337-4489-b9b7-5a5ea18a7bbc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:04.704799 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-089d2558-3337-4489-b9b7-5a5ea18a7bbc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:04.705279 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-089d2558-3337-4489-b9b7-5a5ea18a7bbc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:04.708373 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-089d2558-3337-4489-b9b7-5a5ea18a7bbc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:04.871727 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-089d2558-3337-4489-b9b7-5a5ea18a7bbc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:04.880605 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-089d2558-3337-4489-b9b7-5a5ea18a7bbc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1724 microversion: 2.1 time: 0.189354 Oct 11 12:05:04.882010 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 241/467] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:04 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:05.359979 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-44db29fd-2807-4545-8bf4-f6d38c1ad400 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:05.360609 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-44db29fd-2807-4545-8bf4-f6d38c1ad400 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:05.367808 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-44db29fd-2807-4545-8bf4-f6d38c1ad400 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:05.368296 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-44db29fd-2807-4545-8bf4-f6d38c1ad400 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:05.368732 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-44db29fd-2807-4545-8bf4-f6d38c1ad400 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:05.369439 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-44db29fd-2807-4545-8bf4-f6d38c1ad400 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:05.369887 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-44db29fd-2807-4545-8bf4-f6d38c1ad400 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:05.370312 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-44db29fd-2807-4545-8bf4-f6d38c1ad400 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:05.512188 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-44db29fd-2807-4545-8bf4-f6d38c1ad400 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:05.521579 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-44db29fd-2807-4545-8bf4-f6d38c1ad400 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1735 microversion: 2.1 time: 0.165508 Oct 11 12:05:05.522538 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 227/468] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:05 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:05.906920 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-684f5221-fe53-4a01-824c-0104f4d3c453 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:05.907581 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-684f5221-fe53-4a01-824c-0104f4d3c453 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:05.914445 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-684f5221-fe53-4a01-824c-0104f4d3c453 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:05.914971 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-684f5221-fe53-4a01-824c-0104f4d3c453 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:05.915409 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-684f5221-fe53-4a01-824c-0104f4d3c453 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:05.916128 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-684f5221-fe53-4a01-824c-0104f4d3c453 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:05.916580 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-684f5221-fe53-4a01-824c-0104f4d3c453 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:05.917002 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-684f5221-fe53-4a01-824c-0104f4d3c453 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:06.059451 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-684f5221-fe53-4a01-824c-0104f4d3c453 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:06.068212 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-684f5221-fe53-4a01-824c-0104f4d3c453 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1724 microversion: 2.1 time: 0.165415 Oct 11 12:05:06.068799 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 242/469] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:05 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:06.546177 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-23779639-24b9-4235-89b1-a5af22caba4e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:06.546947 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-23779639-24b9-4235-89b1-a5af22caba4e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:06.554150 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-23779639-24b9-4235-89b1-a5af22caba4e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:06.554715 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-23779639-24b9-4235-89b1-a5af22caba4e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:06.555148 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-23779639-24b9-4235-89b1-a5af22caba4e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:06.555854 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-23779639-24b9-4235-89b1-a5af22caba4e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:06.556293 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-23779639-24b9-4235-89b1-a5af22caba4e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:06.556708 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-23779639-24b9-4235-89b1-a5af22caba4e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:06.704671 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-23779639-24b9-4235-89b1-a5af22caba4e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:06.714424 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-23779639-24b9-4235-89b1-a5af22caba4e tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1735 microversion: 2.1 time: 0.172256 Oct 11 12:05:06.715289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 228/470] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:06 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:07.091913 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3a1a3a97-32dd-4685-96f0-39183b7be8c9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:07.092519 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-3a1a3a97-32dd-4685-96f0-39183b7be8c9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:07.099663 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3a1a3a97-32dd-4685-96f0-39183b7be8c9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:07.100149 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3a1a3a97-32dd-4685-96f0-39183b7be8c9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:07.100576 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3a1a3a97-32dd-4685-96f0-39183b7be8c9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:07.101274 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3a1a3a97-32dd-4685-96f0-39183b7be8c9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:07.101719 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3a1a3a97-32dd-4685-96f0-39183b7be8c9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:07.102138 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3a1a3a97-32dd-4685-96f0-39183b7be8c9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:07.246270 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-3a1a3a97-32dd-4685-96f0-39183b7be8c9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:07.257860 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-3a1a3a97-32dd-4685-96f0-39183b7be8c9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1724 microversion: 2.1 time: 0.169801 Oct 11 12:05:07.258430 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 243/471] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:07 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:07.748475 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-1aabc12e-8be2-47c9-92c6-d50c91228ce1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:07.749053 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-1aabc12e-8be2-47c9-92c6-d50c91228ce1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:07.755826 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1aabc12e-8be2-47c9-92c6-d50c91228ce1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:07.756312 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1aabc12e-8be2-47c9-92c6-d50c91228ce1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:07.756746 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1aabc12e-8be2-47c9-92c6-d50c91228ce1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:07.757432 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1aabc12e-8be2-47c9-92c6-d50c91228ce1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:07.757877 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1aabc12e-8be2-47c9-92c6-d50c91228ce1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:07.758298 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1aabc12e-8be2-47c9-92c6-d50c91228ce1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:08.121379 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-1aabc12e-8be2-47c9-92c6-d50c91228ce1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:08.130031 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-1aabc12e-8be2-47c9-92c6-d50c91228ce1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1735 microversion: 2.1 time: 0.386795 Oct 11 12:05:08.130589 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 229/472] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:07 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1735 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:08.282000 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-213c59ff-5904-4915-8d2f-e1b7277430fd tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:08.282654 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-213c59ff-5904-4915-8d2f-e1b7277430fd tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:08.290576 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-213c59ff-5904-4915-8d2f-e1b7277430fd tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:08.291071 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-213c59ff-5904-4915-8d2f-e1b7277430fd tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:08.291498 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-213c59ff-5904-4915-8d2f-e1b7277430fd tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:08.292253 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-213c59ff-5904-4915-8d2f-e1b7277430fd tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:08.292697 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-213c59ff-5904-4915-8d2f-e1b7277430fd tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:08.293117 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-213c59ff-5904-4915-8d2f-e1b7277430fd tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:08.437559 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-213c59ff-5904-4915-8d2f-e1b7277430fd tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:08.446361 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-213c59ff-5904-4915-8d2f-e1b7277430fd tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1724 microversion: 2.1 time: 0.168593 Oct 11 12:05:08.446984 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 244/473] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:08 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:09.155130 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-f4f268a5-52d1-4f67-b7b3-8bc2559308d0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:09.155905 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-f4f268a5-52d1-4f67-b7b3-8bc2559308d0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:09.164772 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f4f268a5-52d1-4f67-b7b3-8bc2559308d0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:09.165250 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f4f268a5-52d1-4f67-b7b3-8bc2559308d0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:09.165674 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f4f268a5-52d1-4f67-b7b3-8bc2559308d0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:09.166379 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f4f268a5-52d1-4f67-b7b3-8bc2559308d0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:09.166871 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f4f268a5-52d1-4f67-b7b3-8bc2559308d0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:09.167287 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f4f268a5-52d1-4f67-b7b3-8bc2559308d0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:09.313717 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-f4f268a5-52d1-4f67-b7b3-8bc2559308d0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:09.322119 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-f4f268a5-52d1-4f67-b7b3-8bc2559308d0 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1735 microversion: 2.1 time: 0.172098 Oct 11 12:05:09.322753 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 230/474] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:09 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:09.470066 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a4b37a6d-432a-41ea-aa79-d02cba7b2f2c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:09.470662 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a4b37a6d-432a-41ea-aa79-d02cba7b2f2c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:09.477756 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a4b37a6d-432a-41ea-aa79-d02cba7b2f2c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:09.478253 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a4b37a6d-432a-41ea-aa79-d02cba7b2f2c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:09.478724 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a4b37a6d-432a-41ea-aa79-d02cba7b2f2c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:09.479408 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a4b37a6d-432a-41ea-aa79-d02cba7b2f2c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:09.479861 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a4b37a6d-432a-41ea-aa79-d02cba7b2f2c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:09.480281 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a4b37a6d-432a-41ea-aa79-d02cba7b2f2c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:09.628830 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a4b37a6d-432a-41ea-aa79-d02cba7b2f2c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:09.640430 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a4b37a6d-432a-41ea-aa79-d02cba7b2f2c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1724 microversion: 2.1 time: 0.174182 Oct 11 12:05:09.641375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 245/475] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:09 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:10.457007 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-850d3f60-9d2b-4cb3-aa21-e78b41394d31 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:10.457612 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-850d3f60-9d2b-4cb3-aa21-e78b41394d31 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:10.464385 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-850d3f60-9d2b-4cb3-aa21-e78b41394d31 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:10.464860 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-850d3f60-9d2b-4cb3-aa21-e78b41394d31 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:10.465286 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-850d3f60-9d2b-4cb3-aa21-e78b41394d31 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:10.466042 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-850d3f60-9d2b-4cb3-aa21-e78b41394d31 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:10.466484 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-850d3f60-9d2b-4cb3-aa21-e78b41394d31 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:10.466925 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-850d3f60-9d2b-4cb3-aa21-e78b41394d31 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:10.610822 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-850d3f60-9d2b-4cb3-aa21-e78b41394d31 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:10.621451 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-850d3f60-9d2b-4cb3-aa21-e78b41394d31 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1735 microversion: 2.1 time: 0.279814 Oct 11 12:05:10.624423 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 231/476] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:10 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1735 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:10.664812 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2d02bff5-7abd-4eef-b385-0f7495297f8d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:10.665415 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2d02bff5-7abd-4eef-b385-0f7495297f8d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:10.672270 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2d02bff5-7abd-4eef-b385-0f7495297f8d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:10.672756 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2d02bff5-7abd-4eef-b385-0f7495297f8d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:10.673178 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2d02bff5-7abd-4eef-b385-0f7495297f8d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:10.673868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2d02bff5-7abd-4eef-b385-0f7495297f8d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:10.674307 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2d02bff5-7abd-4eef-b385-0f7495297f8d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:10.674771 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2d02bff5-7abd-4eef-b385-0f7495297f8d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:10.830245 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2d02bff5-7abd-4eef-b385-0f7495297f8d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:10.841843 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2d02bff5-7abd-4eef-b385-0f7495297f8d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1724 microversion: 2.1 time: 0.180770 Oct 11 12:05:10.842536 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 246/477] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:10 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:11.645609 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-23bef8ba-4c3a-48bc-b29c-f4f51c59fba7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:11.646157 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-23bef8ba-4c3a-48bc-b29c-f4f51c59fba7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:11.653423 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-23bef8ba-4c3a-48bc-b29c-f4f51c59fba7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:11.653986 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-23bef8ba-4c3a-48bc-b29c-f4f51c59fba7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:11.654419 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-23bef8ba-4c3a-48bc-b29c-f4f51c59fba7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:11.655138 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-23bef8ba-4c3a-48bc-b29c-f4f51c59fba7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:11.655604 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-23bef8ba-4c3a-48bc-b29c-f4f51c59fba7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:11.656023 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-23bef8ba-4c3a-48bc-b29c-f4f51c59fba7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:11.796637 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-23bef8ba-4c3a-48bc-b29c-f4f51c59fba7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:11.805932 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-23bef8ba-4c3a-48bc-b29c-f4f51c59fba7 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1735 microversion: 2.1 time: 0.164300 Oct 11 12:05:11.806509 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 232/478] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:11 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:11.866521 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-abfd87c3-d3fd-452a-9968-4ac38e1965eb tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:11.867135 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-abfd87c3-d3fd-452a-9968-4ac38e1965eb tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:11.874139 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-abfd87c3-d3fd-452a-9968-4ac38e1965eb tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:11.874647 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-abfd87c3-d3fd-452a-9968-4ac38e1965eb tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:11.875158 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-abfd87c3-d3fd-452a-9968-4ac38e1965eb tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:11.875852 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-abfd87c3-d3fd-452a-9968-4ac38e1965eb tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:11.876301 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-abfd87c3-d3fd-452a-9968-4ac38e1965eb tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:11.876724 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-abfd87c3-d3fd-452a-9968-4ac38e1965eb tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:12.016720 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-abfd87c3-d3fd-452a-9968-4ac38e1965eb tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:12.028424 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-abfd87c3-d3fd-452a-9968-4ac38e1965eb tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1724 microversion: 2.1 time: 0.165579 Oct 11 12:05:12.029184 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 247/479] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:11 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:12.829684 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-1642cfc9-7f58-4632-b71e-891dbf685be4 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:12.830270 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-1642cfc9-7f58-4632-b71e-891dbf685be4 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:12.837452 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1642cfc9-7f58-4632-b71e-891dbf685be4 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:12.837943 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1642cfc9-7f58-4632-b71e-891dbf685be4 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:12.838374 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1642cfc9-7f58-4632-b71e-891dbf685be4 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:12.839115 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1642cfc9-7f58-4632-b71e-891dbf685be4 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:12.839552 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1642cfc9-7f58-4632-b71e-891dbf685be4 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:12.839973 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1642cfc9-7f58-4632-b71e-891dbf685be4 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:12.987735 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-1642cfc9-7f58-4632-b71e-891dbf685be4 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:12.996649 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-1642cfc9-7f58-4632-b71e-891dbf685be4 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1735 microversion: 2.1 time: 0.170855 Oct 11 12:05:12.997240 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 233/480] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:12 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:13.053000 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2147ed59-6f2a-4eca-9dcc-001aa5386d42 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:13.053763 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2147ed59-6f2a-4eca-9dcc-001aa5386d42 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:13.060620 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2147ed59-6f2a-4eca-9dcc-001aa5386d42 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:13.061104 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2147ed59-6f2a-4eca-9dcc-001aa5386d42 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:13.061528 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2147ed59-6f2a-4eca-9dcc-001aa5386d42 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:13.062223 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2147ed59-6f2a-4eca-9dcc-001aa5386d42 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:13.062708 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2147ed59-6f2a-4eca-9dcc-001aa5386d42 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:13.063139 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2147ed59-6f2a-4eca-9dcc-001aa5386d42 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:13.082738 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:05:13.207063 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2147ed59-6f2a-4eca-9dcc-001aa5386d42 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:13.222510 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2147ed59-6f2a-4eca-9dcc-001aa5386d42 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1724 microversion: 2.1 time: 0.172939 Oct 11 12:05:13.223781 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 248/481] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:13 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:14.021338 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-618d2f9d-e386-44b2-bd8c-1a4ca63d4588 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:14.022331 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-618d2f9d-e386-44b2-bd8c-1a4ca63d4588 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:14.029011 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-618d2f9d-e386-44b2-bd8c-1a4ca63d4588 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:14.029490 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-618d2f9d-e386-44b2-bd8c-1a4ca63d4588 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:14.029917 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-618d2f9d-e386-44b2-bd8c-1a4ca63d4588 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:14.030634 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-618d2f9d-e386-44b2-bd8c-1a4ca63d4588 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:14.031082 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-618d2f9d-e386-44b2-bd8c-1a4ca63d4588 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:14.031494 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-618d2f9d-e386-44b2-bd8c-1a4ca63d4588 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:14.173556 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-618d2f9d-e386-44b2-bd8c-1a4ca63d4588 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:14.185214 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-618d2f9d-e386-44b2-bd8c-1a4ca63d4588 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1735 microversion: 2.1 time: 0.169113 Oct 11 12:05:14.185867 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 234/482] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:14 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:14.255744 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c6718500-75f1-4518-82a2-95dccc447a5f tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:14.256310 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c6718500-75f1-4518-82a2-95dccc447a5f tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:14.263591 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c6718500-75f1-4518-82a2-95dccc447a5f tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:14.264083 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c6718500-75f1-4518-82a2-95dccc447a5f tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:14.264562 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c6718500-75f1-4518-82a2-95dccc447a5f tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:14.265259 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c6718500-75f1-4518-82a2-95dccc447a5f tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:14.265821 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c6718500-75f1-4518-82a2-95dccc447a5f tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:14.266214 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c6718500-75f1-4518-82a2-95dccc447a5f tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:14.405404 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c6718500-75f1-4518-82a2-95dccc447a5f tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:14.417021 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c6718500-75f1-4518-82a2-95dccc447a5f tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1724 microversion: 2.1 time: 0.165061 Oct 11 12:05:14.417877 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 249/483] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:14 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:15.209482 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-45c1981a-9f90-4f55-b5f7-ea631d2b119b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:15.210060 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-45c1981a-9f90-4f55-b5f7-ea631d2b119b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:15.217061 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-45c1981a-9f90-4f55-b5f7-ea631d2b119b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:15.217551 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-45c1981a-9f90-4f55-b5f7-ea631d2b119b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:15.217984 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-45c1981a-9f90-4f55-b5f7-ea631d2b119b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:15.218862 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-45c1981a-9f90-4f55-b5f7-ea631d2b119b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:15.219331 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-45c1981a-9f90-4f55-b5f7-ea631d2b119b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:15.219751 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-45c1981a-9f90-4f55-b5f7-ea631d2b119b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:15.223067 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=94,nova_cell1:INSERT=2 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:05:15.364206 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-45c1981a-9f90-4f55-b5f7-ea631d2b119b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:15.373330 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-45c1981a-9f90-4f55-b5f7-ea631d2b119b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1735 microversion: 2.1 time: 0.168539 Oct 11 12:05:15.373911 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 235/484] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:15 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:15.448054 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c701273e-c4f2-4714-91ac-3dddc4a0e5cb tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:15.448661 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c701273e-c4f2-4714-91ac-3dddc4a0e5cb tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:15.455771 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c701273e-c4f2-4714-91ac-3dddc4a0e5cb tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:15.456257 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c701273e-c4f2-4714-91ac-3dddc4a0e5cb tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:15.456667 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c701273e-c4f2-4714-91ac-3dddc4a0e5cb tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:15.457362 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c701273e-c4f2-4714-91ac-3dddc4a0e5cb tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:15.457812 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c701273e-c4f2-4714-91ac-3dddc4a0e5cb tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:15.458239 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c701273e-c4f2-4714-91ac-3dddc4a0e5cb tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:15.594388 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c701273e-c4f2-4714-91ac-3dddc4a0e5cb tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:15.603390 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c701273e-c4f2-4714-91ac-3dddc4a0e5cb tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1724 microversion: 2.1 time: 0.159568 Oct 11 12:05:15.604016 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 250/485] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:15 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:16.399180 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-7524b9d4-064e-4997-af16-b8849b8bdfd1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:16.399813 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-7524b9d4-064e-4997-af16-b8849b8bdfd1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:16.408894 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7524b9d4-064e-4997-af16-b8849b8bdfd1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:16.409377 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7524b9d4-064e-4997-af16-b8849b8bdfd1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:16.409810 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7524b9d4-064e-4997-af16-b8849b8bdfd1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:16.410509 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7524b9d4-064e-4997-af16-b8849b8bdfd1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:16.410993 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7524b9d4-064e-4997-af16-b8849b8bdfd1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:16.411413 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7524b9d4-064e-4997-af16-b8849b8bdfd1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:16.558906 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-7524b9d4-064e-4997-af16-b8849b8bdfd1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:16.567731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-7524b9d4-064e-4997-af16-b8849b8bdfd1 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1735 microversion: 2.1 time: 0.174314 Oct 11 12:05:16.568282 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 236/486] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:16 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:16.628192 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f8e7e6f7-34fe-46aa-a4f4-613d9db599af tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:16.628847 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f8e7e6f7-34fe-46aa-a4f4-613d9db599af tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:16.635699 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f8e7e6f7-34fe-46aa-a4f4-613d9db599af tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:16.636176 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f8e7e6f7-34fe-46aa-a4f4-613d9db599af tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:16.636602 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f8e7e6f7-34fe-46aa-a4f4-613d9db599af tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:16.637291 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f8e7e6f7-34fe-46aa-a4f4-613d9db599af tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:16.637734 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f8e7e6f7-34fe-46aa-a4f4-613d9db599af tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:16.638148 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f8e7e6f7-34fe-46aa-a4f4-613d9db599af tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:16.772368 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f8e7e6f7-34fe-46aa-a4f4-613d9db599af tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:16.782006 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f8e7e6f7-34fe-46aa-a4f4-613d9db599af tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1724 microversion: 2.1 time: 0.158355 Oct 11 12:05:16.782608 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 251/487] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:16 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:17.592159 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-e965ca8b-2063-4bf5-8b7f-eeafb4e8d6aa tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:17.592762 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-e965ca8b-2063-4bf5-8b7f-eeafb4e8d6aa tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:17.599550 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e965ca8b-2063-4bf5-8b7f-eeafb4e8d6aa tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:17.600038 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e965ca8b-2063-4bf5-8b7f-eeafb4e8d6aa tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:17.600472 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e965ca8b-2063-4bf5-8b7f-eeafb4e8d6aa tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:17.601249 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e965ca8b-2063-4bf5-8b7f-eeafb4e8d6aa tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:17.601617 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e965ca8b-2063-4bf5-8b7f-eeafb4e8d6aa tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:17.602030 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e965ca8b-2063-4bf5-8b7f-eeafb4e8d6aa tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:17.741688 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-e965ca8b-2063-4bf5-8b7f-eeafb4e8d6aa tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:17.750417 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-e965ca8b-2063-4bf5-8b7f-eeafb4e8d6aa tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1735 microversion: 2.1 time: 0.163065 Oct 11 12:05:17.750996 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 237/488] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:17 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:17.807078 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-81225eec-2689-4da9-9d31-2caf86291f23 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:17.807688 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-81225eec-2689-4da9-9d31-2caf86291f23 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:17.818467 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-81225eec-2689-4da9-9d31-2caf86291f23 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:17.819077 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-81225eec-2689-4da9-9d31-2caf86291f23 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:17.819832 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-81225eec-2689-4da9-9d31-2caf86291f23 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:17.820894 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-81225eec-2689-4da9-9d31-2caf86291f23 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:17.821642 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-81225eec-2689-4da9-9d31-2caf86291f23 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:17.822324 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-81225eec-2689-4da9-9d31-2caf86291f23 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:17.974212 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-81225eec-2689-4da9-9d31-2caf86291f23 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:17.982845 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-81225eec-2689-4da9-9d31-2caf86291f23 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1724 microversion: 2.1 time: 0.180079 Oct 11 12:05:17.983435 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 252/489] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:17 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:18.774162 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-3dc9f23a-9203-4f6d-a3d2-c90baae5f022 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:18.774814 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-3dc9f23a-9203-4f6d-a3d2-c90baae5f022 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:18.782213 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3dc9f23a-9203-4f6d-a3d2-c90baae5f022 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:18.782729 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3dc9f23a-9203-4f6d-a3d2-c90baae5f022 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:18.783161 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3dc9f23a-9203-4f6d-a3d2-c90baae5f022 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:18.783850 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3dc9f23a-9203-4f6d-a3d2-c90baae5f022 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:18.784298 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3dc9f23a-9203-4f6d-a3d2-c90baae5f022 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:18.784719 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3dc9f23a-9203-4f6d-a3d2-c90baae5f022 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:18.925001 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-3dc9f23a-9203-4f6d-a3d2-c90baae5f022 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:18.933623 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-3dc9f23a-9203-4f6d-a3d2-c90baae5f022 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1735 microversion: 2.1 time: 0.163704 Oct 11 12:05:18.934177 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 238/490] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:18 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:19.006634 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-60c004b2-f589-4b59-99ea-623be111b864 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:19.007254 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-60c004b2-f589-4b59-99ea-623be111b864 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:19.013918 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-60c004b2-f589-4b59-99ea-623be111b864 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:19.014398 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-60c004b2-f589-4b59-99ea-623be111b864 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:19.014865 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-60c004b2-f589-4b59-99ea-623be111b864 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:19.015680 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-60c004b2-f589-4b59-99ea-623be111b864 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:19.016118 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-60c004b2-f589-4b59-99ea-623be111b864 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:19.016542 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-60c004b2-f589-4b59-99ea-623be111b864 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:19.155578 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-60c004b2-f589-4b59-99ea-623be111b864 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:19.164216 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-60c004b2-f589-4b59-99ea-623be111b864 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1724 microversion: 2.1 time: 0.161510 Oct 11 12:05:19.164802 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 253/491] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:19 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:19.957510 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-3f54ee2c-3de2-4ffe-83ab-c185d1762232 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:19.958167 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-3f54ee2c-3de2-4ffe-83ab-c185d1762232 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:19.964890 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3f54ee2c-3de2-4ffe-83ab-c185d1762232 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:19.965455 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3f54ee2c-3de2-4ffe-83ab-c185d1762232 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:19.966161 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3f54ee2c-3de2-4ffe-83ab-c185d1762232 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:19.966904 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3f54ee2c-3de2-4ffe-83ab-c185d1762232 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:19.967759 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3f54ee2c-3de2-4ffe-83ab-c185d1762232 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:19.967980 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3f54ee2c-3de2-4ffe-83ab-c185d1762232 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:20.116093 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-3f54ee2c-3de2-4ffe-83ab-c185d1762232 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:20.125028 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-3f54ee2c-3de2-4ffe-83ab-c185d1762232 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1735 microversion: 2.1 time: 0.171571 Oct 11 12:05:20.125610 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 239/492] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:19 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:20.187565 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-030b0a7c-efdd-43c4-869b-6475948ffdd4 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:20.188148 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-030b0a7c-efdd-43c4-869b-6475948ffdd4 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:20.194900 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-030b0a7c-efdd-43c4-869b-6475948ffdd4 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:20.195387 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-030b0a7c-efdd-43c4-869b-6475948ffdd4 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:20.195820 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-030b0a7c-efdd-43c4-869b-6475948ffdd4 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:20.196540 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-030b0a7c-efdd-43c4-869b-6475948ffdd4 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:20.196985 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-030b0a7c-efdd-43c4-869b-6475948ffdd4 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:20.197403 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-030b0a7c-efdd-43c4-869b-6475948ffdd4 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:20.339740 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-030b0a7c-efdd-43c4-869b-6475948ffdd4 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:20.348888 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-030b0a7c-efdd-43c4-869b-6475948ffdd4 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1724 microversion: 2.1 time: 0.165387 Oct 11 12:05:20.349469 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 254/493] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:20 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:21.150376 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-82cb60e1-4440-4e90-8d40-9900e2205c62 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:21.151009 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-82cb60e1-4440-4e90-8d40-9900e2205c62 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:21.158388 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-82cb60e1-4440-4e90-8d40-9900e2205c62 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:21.158889 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-82cb60e1-4440-4e90-8d40-9900e2205c62 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:21.159316 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-82cb60e1-4440-4e90-8d40-9900e2205c62 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:21.160005 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-82cb60e1-4440-4e90-8d40-9900e2205c62 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:21.160444 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-82cb60e1-4440-4e90-8d40-9900e2205c62 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:21.160857 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-82cb60e1-4440-4e90-8d40-9900e2205c62 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:21.306976 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-82cb60e1-4440-4e90-8d40-9900e2205c62 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:21.315407 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-82cb60e1-4440-4e90-8d40-9900e2205c62 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1735 microversion: 2.1 time: 0.169329 Oct 11 12:05:21.315972 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 240/494] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:21 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:21.372422 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ef64d976-af96-4a5a-9804-4d69d73888ea tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:21.372980 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ef64d976-af96-4a5a-9804-4d69d73888ea tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:21.379985 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ef64d976-af96-4a5a-9804-4d69d73888ea tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:21.380484 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ef64d976-af96-4a5a-9804-4d69d73888ea tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:21.380877 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ef64d976-af96-4a5a-9804-4d69d73888ea tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:21.381593 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ef64d976-af96-4a5a-9804-4d69d73888ea tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:21.382044 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ef64d976-af96-4a5a-9804-4d69d73888ea tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:21.382468 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ef64d976-af96-4a5a-9804-4d69d73888ea tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:21.515054 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ef64d976-af96-4a5a-9804-4d69d73888ea tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:21.526284 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ef64d976-af96-4a5a-9804-4d69d73888ea tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1724 microversion: 2.1 time: 0.157734 Oct 11 12:05:21.526898 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 255/495] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:21 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:22.343547 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-1f61a6f2-c70f-4a83-bdaf-692847061d84 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:22.344448 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-1f61a6f2-c70f-4a83-bdaf-692847061d84 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:22.346851 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 12:05:22.346989 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Tue Oct 11 12:05:22 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa (ip 10.222.0.59) !!! Oct 11 12:05:22.359156 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1f61a6f2-c70f-4a83-bdaf-692847061d84 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:22.359637 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1f61a6f2-c70f-4a83-bdaf-692847061d84 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:22.360062 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1f61a6f2-c70f-4a83-bdaf-692847061d84 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:22.360754 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1f61a6f2-c70f-4a83-bdaf-692847061d84 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:22.361192 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1f61a6f2-c70f-4a83-bdaf-692847061d84 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:22.361606 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1f61a6f2-c70f-4a83-bdaf-692847061d84 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:22.494207 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-1f61a6f2-c70f-4a83-bdaf-692847061d84 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:22.504208 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-1f61a6f2-c70f-4a83-bdaf-692847061d84 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1735 microversion: 2.1 time: 0.168413 Oct 11 12:05:22.519204 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 241/496] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:22 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1735 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:22.550034 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a8e68be1-2e06-4f55-941a-31a24c11485d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:22.550923 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a8e68be1-2e06-4f55-941a-31a24c11485d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:22.558307 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a8e68be1-2e06-4f55-941a-31a24c11485d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:22.558897 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a8e68be1-2e06-4f55-941a-31a24c11485d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:22.559380 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a8e68be1-2e06-4f55-941a-31a24c11485d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:22.560069 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a8e68be1-2e06-4f55-941a-31a24c11485d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:22.560514 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a8e68be1-2e06-4f55-941a-31a24c11485d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:22.560939 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a8e68be1-2e06-4f55-941a-31a24c11485d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:22.697384 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a8e68be1-2e06-4f55-941a-31a24c11485d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:22.710830 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a8e68be1-2e06-4f55-941a-31a24c11485d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1701 microversion: 2.1 time: 0.164456 Oct 11 12:05:22.711608 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 256/497] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:22 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1701 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:22.733977 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-70f5458f-d554-42a3-a78a-916813120cc5 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:05:22.741242 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-70f5458f-d554-42a3-a78a-916813120cc5 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:22.741724 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-70f5458f-d554-42a3-a78a-916813120cc5 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:22.742146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-70f5458f-d554-42a3-a78a-916813120cc5 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:22.801581 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-70f5458f-d554-42a3-a78a-916813120cc5 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Going to try to start instance {{(pid=118994) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 12:05:22.854263 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-70f5458f-d554-42a3-a78a-916813120cc5 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "POST /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91/action" status: 202 len: 0 microversion: 2.1 time: 0.123913 Oct 11 12:05:22.855098 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 242/498] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Oct 11 12:05:22 2022] POST /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 12:05:22.866542 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e36d91fe-fcb2-4e8e-b955-240a7c71fe22 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:22.867505 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e36d91fe-fcb2-4e8e-b955-240a7c71fe22 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:22.876795 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e36d91fe-fcb2-4e8e-b955-240a7c71fe22 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:22.877483 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e36d91fe-fcb2-4e8e-b955-240a7c71fe22 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:22.878083 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e36d91fe-fcb2-4e8e-b955-240a7c71fe22 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:22.879092 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e36d91fe-fcb2-4e8e-b955-240a7c71fe22 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:22.879642 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e36d91fe-fcb2-4e8e-b955-240a7c71fe22 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:22.880216 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e36d91fe-fcb2-4e8e-b955-240a7c71fe22 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:23.021053 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e36d91fe-fcb2-4e8e-b955-240a7c71fe22 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:23.033923 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e36d91fe-fcb2-4e8e-b955-240a7c71fe22 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1710 microversion: 2.1 time: 0.173373 Oct 11 12:05:23.034681 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 257/499] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:22 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1710 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:23.531772 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-f4a1c407-e3b1-4d70-9e96-f13fe9cfee02 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:23.532538 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-f4a1c407-e3b1-4d70-9e96-f13fe9cfee02 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:23.540474 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f4a1c407-e3b1-4d70-9e96-f13fe9cfee02 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:23.540946 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f4a1c407-e3b1-4d70-9e96-f13fe9cfee02 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:23.541369 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f4a1c407-e3b1-4d70-9e96-f13fe9cfee02 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:23.542449 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f4a1c407-e3b1-4d70-9e96-f13fe9cfee02 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:23.542449 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f4a1c407-e3b1-4d70-9e96-f13fe9cfee02 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:23.542915 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f4a1c407-e3b1-4d70-9e96-f13fe9cfee02 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:23.678974 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-f4a1c407-e3b1-4d70-9e96-f13fe9cfee02 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:23.687705 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-f4a1c407-e3b1-4d70-9e96-f13fe9cfee02 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1735 microversion: 2.1 time: 0.162605 Oct 11 12:05:23.688285 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 243/500] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:23 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:24.060881 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6cf4c698-5747-4092-8b1c-5402a2e9edcc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:24.061767 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-6cf4c698-5747-4092-8b1c-5402a2e9edcc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:24.068671 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6cf4c698-5747-4092-8b1c-5402a2e9edcc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:24.069145 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6cf4c698-5747-4092-8b1c-5402a2e9edcc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:24.069574 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6cf4c698-5747-4092-8b1c-5402a2e9edcc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:24.070270 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6cf4c698-5747-4092-8b1c-5402a2e9edcc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:24.070753 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6cf4c698-5747-4092-8b1c-5402a2e9edcc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:24.071180 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6cf4c698-5747-4092-8b1c-5402a2e9edcc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:24.209168 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6cf4c698-5747-4092-8b1c-5402a2e9edcc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:24.218065 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6cf4c698-5747-4092-8b1c-5402a2e9edcc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1710 microversion: 2.1 time: 0.163803 Oct 11 12:05:24.218535 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 258/501] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:24 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1710 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:24.712783 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-c8e5424f-b4bf-43fe-a892-9c529adefb46 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:24.713394 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-c8e5424f-b4bf-43fe-a892-9c529adefb46 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:24.720659 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c8e5424f-b4bf-43fe-a892-9c529adefb46 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:24.721141 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c8e5424f-b4bf-43fe-a892-9c529adefb46 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:24.721596 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c8e5424f-b4bf-43fe-a892-9c529adefb46 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:24.722298 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c8e5424f-b4bf-43fe-a892-9c529adefb46 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:24.722770 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c8e5424f-b4bf-43fe-a892-9c529adefb46 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:24.723199 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c8e5424f-b4bf-43fe-a892-9c529adefb46 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:24.863058 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-c8e5424f-b4bf-43fe-a892-9c529adefb46 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:24.872013 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-c8e5424f-b4bf-43fe-a892-9c529adefb46 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1735 microversion: 2.1 time: 0.163275 Oct 11 12:05:24.872583 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 244/502] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:24 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:25.242022 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-4dc8bae2-e595-431e-bab4-03d41d8ba1fa tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:25.242655 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-4dc8bae2-e595-431e-bab4-03d41d8ba1fa tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:25.249467 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4dc8bae2-e595-431e-bab4-03d41d8ba1fa tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:25.249945 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4dc8bae2-e595-431e-bab4-03d41d8ba1fa tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:25.250368 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4dc8bae2-e595-431e-bab4-03d41d8ba1fa tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:25.251087 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4dc8bae2-e595-431e-bab4-03d41d8ba1fa tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:25.251527 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4dc8bae2-e595-431e-bab4-03d41d8ba1fa tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:25.251942 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4dc8bae2-e595-431e-bab4-03d41d8ba1fa tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:25.402286 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-4dc8bae2-e595-431e-bab4-03d41d8ba1fa tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:25.411216 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-4dc8bae2-e595-431e-bab4-03d41d8ba1fa tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1710 microversion: 2.1 time: 0.173064 Oct 11 12:05:25.411787 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 259/503] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:25 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1710 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:25.898984 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-03a6cb54-d0a6-49cf-8e51-0205f181736a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:25.899650 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-03a6cb54-d0a6-49cf-8e51-0205f181736a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:25.908895 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-03a6cb54-d0a6-49cf-8e51-0205f181736a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:25.909552 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-03a6cb54-d0a6-49cf-8e51-0205f181736a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:25.910044 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-03a6cb54-d0a6-49cf-8e51-0205f181736a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:25.911039 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-03a6cb54-d0a6-49cf-8e51-0205f181736a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:25.911598 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-03a6cb54-d0a6-49cf-8e51-0205f181736a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:25.912186 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-03a6cb54-d0a6-49cf-8e51-0205f181736a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:26.060132 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-03a6cb54-d0a6-49cf-8e51-0205f181736a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:26.072520 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-03a6cb54-d0a6-49cf-8e51-0205f181736a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1735 microversion: 2.1 time: 0.179311 Oct 11 12:05:26.073324 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 245/504] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:25 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:26.436500 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d3d17adf-59ec-4091-b5c4-ee2a76ea0968 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:26.437261 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d3d17adf-59ec-4091-b5c4-ee2a76ea0968 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:26.440265 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=51 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:05:26.445703 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d3d17adf-59ec-4091-b5c4-ee2a76ea0968 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:26.446241 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d3d17adf-59ec-4091-b5c4-ee2a76ea0968 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:26.446757 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d3d17adf-59ec-4091-b5c4-ee2a76ea0968 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:26.447575 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d3d17adf-59ec-4091-b5c4-ee2a76ea0968 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:26.448057 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d3d17adf-59ec-4091-b5c4-ee2a76ea0968 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:26.448514 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d3d17adf-59ec-4091-b5c4-ee2a76ea0968 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:26.593855 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d3d17adf-59ec-4091-b5c4-ee2a76ea0968 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:26.602732 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d3d17adf-59ec-4091-b5c4-ee2a76ea0968 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1710 microversion: 2.1 time: 0.171109 Oct 11 12:05:26.603319 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 260/505] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:26 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1710 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:27.098200 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-0e990a42-7108-43d0-9306-fca36a0ba429 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:27.098844 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-0e990a42-7108-43d0-9306-fca36a0ba429 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:27.101389 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_api:SELECT=50 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:05:27.107117 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0e990a42-7108-43d0-9306-fca36a0ba429 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:27.107580 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0e990a42-7108-43d0-9306-fca36a0ba429 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:27.108045 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0e990a42-7108-43d0-9306-fca36a0ba429 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:27.108748 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0e990a42-7108-43d0-9306-fca36a0ba429 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:27.109170 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0e990a42-7108-43d0-9306-fca36a0ba429 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:27.109624 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0e990a42-7108-43d0-9306-fca36a0ba429 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:27.248686 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-0e990a42-7108-43d0-9306-fca36a0ba429 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:27.257031 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-0e990a42-7108-43d0-9306-fca36a0ba429 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1735 microversion: 2.1 time: 0.162917 Oct 11 12:05:27.257600 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 246/506] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:27 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:27.625844 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e0279662-5698-4bfe-aa3b-bd16db1b977d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:27.626578 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e0279662-5698-4bfe-aa3b-bd16db1b977d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:27.628969 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 12:05:27.629095 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Tue Oct 11 12:05:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 (ip 10.222.0.59) !!! Oct 11 12:05:27.642232 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e0279662-5698-4bfe-aa3b-bd16db1b977d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:27.642745 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e0279662-5698-4bfe-aa3b-bd16db1b977d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:27.643170 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e0279662-5698-4bfe-aa3b-bd16db1b977d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:27.643869 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e0279662-5698-4bfe-aa3b-bd16db1b977d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:27.644306 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e0279662-5698-4bfe-aa3b-bd16db1b977d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:27.644723 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e0279662-5698-4bfe-aa3b-bd16db1b977d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:27.822648 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e0279662-5698-4bfe-aa3b-bd16db1b977d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:27.831151 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e0279662-5698-4bfe-aa3b-bd16db1b977d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1710 microversion: 2.1 time: 0.209221 Oct 11 12:05:27.831682 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 261/507] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:27 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1710 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:28.280954 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-4d2d75e2-908b-4f62-b42b-e1873a92fcbb tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:28.281628 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-4d2d75e2-908b-4f62-b42b-e1873a92fcbb tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:28.288670 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4d2d75e2-908b-4f62-b42b-e1873a92fcbb tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:28.289151 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4d2d75e2-908b-4f62-b42b-e1873a92fcbb tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:28.289574 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4d2d75e2-908b-4f62-b42b-e1873a92fcbb tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:28.290305 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4d2d75e2-908b-4f62-b42b-e1873a92fcbb tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:28.290801 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4d2d75e2-908b-4f62-b42b-e1873a92fcbb tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:28.291226 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4d2d75e2-908b-4f62-b42b-e1873a92fcbb tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:28.443437 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-4d2d75e2-908b-4f62-b42b-e1873a92fcbb tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:28.452167 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-4d2d75e2-908b-4f62-b42b-e1873a92fcbb tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1735 microversion: 2.1 time: 0.175098 Oct 11 12:05:28.452745 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 247/508] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:28 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:28.858154 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9550fcee-e8f7-430b-bd6b-d7e7677f0101 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:28.858938 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9550fcee-e8f7-430b-bd6b-d7e7677f0101 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:28.868724 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9550fcee-e8f7-430b-bd6b-d7e7677f0101 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:28.869317 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9550fcee-e8f7-430b-bd6b-d7e7677f0101 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:28.869747 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9550fcee-e8f7-430b-bd6b-d7e7677f0101 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:28.870435 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9550fcee-e8f7-430b-bd6b-d7e7677f0101 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:28.870903 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9550fcee-e8f7-430b-bd6b-d7e7677f0101 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:28.871345 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9550fcee-e8f7-430b-bd6b-d7e7677f0101 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:29.018180 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-9550fcee-e8f7-430b-bd6b-d7e7677f0101 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:29.027374 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9550fcee-e8f7-430b-bd6b-d7e7677f0101 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1710 microversion: 2.1 time: 0.173094 Oct 11 12:05:29.027974 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 262/509] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:28 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1710 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:29.476621 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-e0cf0457-551c-481e-86f7-e815b7ca3832 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:29.477195 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-e0cf0457-551c-481e-86f7-e815b7ca3832 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:29.484027 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e0cf0457-551c-481e-86f7-e815b7ca3832 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:29.484505 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e0cf0457-551c-481e-86f7-e815b7ca3832 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:29.484936 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e0cf0457-551c-481e-86f7-e815b7ca3832 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:29.485634 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e0cf0457-551c-481e-86f7-e815b7ca3832 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:29.486077 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e0cf0457-551c-481e-86f7-e815b7ca3832 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:29.486588 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e0cf0457-551c-481e-86f7-e815b7ca3832 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:29.627643 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-e0cf0457-551c-481e-86f7-e815b7ca3832 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:29.636297 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-e0cf0457-551c-481e-86f7-e815b7ca3832 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1735 microversion: 2.1 time: 0.163698 Oct 11 12:05:29.636893 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 248/510] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:29 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:30.051474 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-4f5420e8-38a3-41b1-9354-fd4db3a0fb44 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:30.052088 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-4f5420e8-38a3-41b1-9354-fd4db3a0fb44 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:30.059285 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f5420e8-38a3-41b1-9354-fd4db3a0fb44 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:30.059827 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f5420e8-38a3-41b1-9354-fd4db3a0fb44 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:30.060264 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f5420e8-38a3-41b1-9354-fd4db3a0fb44 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:30.060974 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f5420e8-38a3-41b1-9354-fd4db3a0fb44 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:30.061430 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f5420e8-38a3-41b1-9354-fd4db3a0fb44 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:30.061853 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f5420e8-38a3-41b1-9354-fd4db3a0fb44 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:30.450318 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-4f5420e8-38a3-41b1-9354-fd4db3a0fb44 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:30.458900 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-4f5420e8-38a3-41b1-9354-fd4db3a0fb44 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1710 microversion: 2.1 time: 0.411365 Oct 11 12:05:30.459610 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 263/511] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:30 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1710 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:30.661101 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-f0372151-c920-4ddb-a34a-cc4a1beb1dc8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:30.661712 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-f0372151-c920-4ddb-a34a-cc4a1beb1dc8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:30.668690 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f0372151-c920-4ddb-a34a-cc4a1beb1dc8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:30.669167 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f0372151-c920-4ddb-a34a-cc4a1beb1dc8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:30.669585 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f0372151-c920-4ddb-a34a-cc4a1beb1dc8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:30.670283 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f0372151-c920-4ddb-a34a-cc4a1beb1dc8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:30.670800 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f0372151-c920-4ddb-a34a-cc4a1beb1dc8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:30.671220 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f0372151-c920-4ddb-a34a-cc4a1beb1dc8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:30.811568 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-f0372151-c920-4ddb-a34a-cc4a1beb1dc8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:30.820046 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-f0372151-c920-4ddb-a34a-cc4a1beb1dc8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1715 microversion: 2.1 time: 0.163592 Oct 11 12:05:30.820624 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 249/512] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:30 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1715 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:30.883546 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2cab44d8-b571-40b9-a7b7-4039adf5ab4d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:30.884040 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2cab44d8-b571-40b9-a7b7-4039adf5ab4d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:30.890569 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2cab44d8-b571-40b9-a7b7-4039adf5ab4d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:30.891097 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2cab44d8-b571-40b9-a7b7-4039adf5ab4d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:30.891514 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2cab44d8-b571-40b9-a7b7-4039adf5ab4d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:30.892213 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2cab44d8-b571-40b9-a7b7-4039adf5ab4d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:30.892719 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2cab44d8-b571-40b9-a7b7-4039adf5ab4d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:30.893140 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2cab44d8-b571-40b9-a7b7-4039adf5ab4d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:31.028647 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-2cab44d8-b571-40b9-a7b7-4039adf5ab4d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] HTTP exception thrown: Cannot 'detach_volume' instance 1be649cc-66ab-45f6-8477-19a7263944fa while it is in vm_state rescued Oct 11 12:05:31.030310 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2cab44d8-b571-40b9-a7b7-4039adf5ab4d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Request method failure captured: Oct 11 12:05:31.030310 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: request: DELETE /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa/os-volume_attachments/476dd514-0fa6-410a-b047-2fe7446ba84e HTTP/1.1 Oct 11 12:05:31.030310 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 11 12:05:31.030310 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 11 12:05:31.030310 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Connection: close Oct 11 12:05:31.030310 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 11 12:05:31.030310 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 11 12:05:31.030310 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Host: 10.222.0.59 Oct 11 12:05:31.030310 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 11 12:05:31.030310 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 11 12:05:31.030310 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjRVrJaSzGAAsqN9YGFXD6DdIsLyt5xdpqMt74hKm0_jmhSi4ZXRo-fmMLSlB8g5keLfi_7ztQVJjqAgS19u6mD9NIFMQvvckksKoE6xupAQa0kDeitdjWA3oiAr9oO9Gi_CEanhcbJ1BGNm6XToopMs81aIIr4CbmeaUmYW-C9S4ctTo Oct 11 12:05:31.030310 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 11 12:05:31.030310 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 11 12:05:31.030310 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 11 12:05:31.030310 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 11 12:05:31.030310 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 11 12:05:31.030310 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 11 12:05:31.030310 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Id: e3e6a648f46646cea42b910d02e0628f Oct 11 12:05:31.030310 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-166493339 Oct 11 12:05:31.030310 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Role: reader,member Oct 11 12:05:31.030310 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Roles: reader,member Oct 11 12:05:31.032070 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e3e6a648f46646cea42b910d02e0628f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e3e6a648f46646cea42b910d02e0628f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e3e6a648f46646cea42b910d02e0628f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e3e6a648f46646cea42b910d02e0628f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:05:31.032070 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-ServerRescueNegativeTestJSON-166493339 Oct 11 12:05:31.032070 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Id: e3e6a648f46646cea42b910d02e0628f Oct 11 12:05:31.032070 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-166493339 Oct 11 12:05:31.032070 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User: tempest-ServerRescueNegativeTestJSON-166493339-project Oct 11 12:05:31.032070 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 11 12:05:31.032070 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 11 12:05:31.032070 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Id: c58107eee1b94541a330c26d7b82a53b Oct 11 12:05:31.032070 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-ServerRescueNegativeTestJSON-166493339-project Oct 11 12:05:31.032070 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: method: > Oct 11 12:05:31.032070 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: exception: Cannot 'detach_volume' instance 1be649cc-66ab-45f6-8477-19a7263944fa while it is in vm_state rescued Oct 11 12:05:31.033240 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: action_args: {'server_id': '1be649cc-66ab-45f6-8477-19a7263944fa', 'id': '476dd514-0fa6-410a-b047-2fe7446ba84e'} Oct 11 12:05:31.033240 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:05:31.033240 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:05:31.033240 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 11 12:05:31.033240 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 11 12:05:31.033240 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 12:05:31.033240 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 12:05:31.033240 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 12:05:31.033240 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 12:05:31.033240 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 1be649cc-66ab-45f6-8477-19a7263944fa in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 11 12:05:31.033240 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:05:31.033240 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:05:31.033240 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:05:31.033240 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:05:31.033240 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:05:31.033240 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:05:31.033240 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:05:31.033240 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:05:31.033240 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:05:31.033240 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:05:31.034471 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 11 12:05:31.034471 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 12:05:31.034471 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 12:05:31.034471 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 12:05:31.034471 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 1be649cc-66ab-45f6-8477-19a7263944fa while it is in vm_state rescued Oct 11 12:05:31.034471 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:05:31.034471 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:05:31.034471 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:05:31.034471 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:05:31.034471 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:05:31.034471 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:05:31.034471 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:05:31.034471 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:05:31.034471 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 1be649cc-66ab-45f6-8477-19a7263944fa while it is in vm_state rescued Oct 11 12:05:31.034471 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:05:31.034471 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2cab44d8-b571-40b9-a7b7-4039adf5ab4d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Returning 409 to user: Cannot 'detach_volume' instance 1be649cc-66ab-45f6-8477-19a7263944fa while it is in vm_state rescued {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:05:31.036123 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2cab44d8-b571-40b9-a7b7-4039adf5ab4d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa/os-volume_attachments/476dd514-0fa6-410a-b047-2fe7446ba84e" status: 409 len: 152 microversion: 2.1 time: 0.152434 Oct 11 12:05:31.036123 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 264/513] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Oct 11 12:05:30 2022] DELETE /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa/os-volume_attachments/476dd514-0fa6-410a-b047-2fe7446ba84e => generated 152 bytes in 154 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 12:05:31.042896 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-37a744ac-e6a2-433a-a7f6-338479195d10 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:31.043092 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5ec65bbf-3c1d-41d9-96d0-e817285f824f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:05:31.043383 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-37a744ac-e6a2-433a-a7f6-338479195d10 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 9c9bc278-9d35-4a42-b77f-579500fbdc0b] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:31.043512 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-5ec65bbf-3c1d-41d9-96d0-e817285f824f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:31.050670 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5ec65bbf-3c1d-41d9-96d0-e817285f824f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:31.051399 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5ec65bbf-3c1d-41d9-96d0-e817285f824f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:31.052017 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5ec65bbf-3c1d-41d9-96d0-e817285f824f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:31.052735 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5ec65bbf-3c1d-41d9-96d0-e817285f824f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:31.053424 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5ec65bbf-3c1d-41d9-96d0-e817285f824f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:31.053611 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5ec65bbf-3c1d-41d9-96d0-e817285f824f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:31.054777 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-37a744ac-e6a2-433a-a7f6-338479195d10 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:31.055235 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-37a744ac-e6a2-433a-a7f6-338479195d10 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:31.055700 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-37a744ac-e6a2-433a-a7f6-338479195d10 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:31.056571 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-37a744ac-e6a2-433a-a7f6-338479195d10 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:31.057023 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-37a744ac-e6a2-433a-a7f6-338479195d10 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:31.057433 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-37a744ac-e6a2-433a-a7f6-338479195d10 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:31.058641 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=100 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:05:31.129099 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5ec65bbf-3c1d-41d9-96d0-e817285f824f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "POST /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa/action" status: 202 len: 0 microversion: 2.1 time: 0.089860 Oct 11 12:05:31.129958 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 265/514] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Oct 11 12:05:31 2022] POST /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 12:05:31.139496 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-32b75f2b-3bcd-44cb-a505-38ec5f003c42 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:31.140123 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-32b75f2b-3bcd-44cb-a505-38ec5f003c42 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:31.147266 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-32b75f2b-3bcd-44cb-a505-38ec5f003c42 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:31.147769 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-32b75f2b-3bcd-44cb-a505-38ec5f003c42 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:31.148475 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-32b75f2b-3bcd-44cb-a505-38ec5f003c42 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:31.149233 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-32b75f2b-3bcd-44cb-a505-38ec5f003c42 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:31.149767 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-32b75f2b-3bcd-44cb-a505-38ec5f003c42 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:31.150191 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-32b75f2b-3bcd-44cb-a505-38ec5f003c42 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:31.194331 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:05:31.198407 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.objects.instance [None req-37a744ac-e6a2-433a-a7f6-338479195d10 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lazy-loading 'services' on Instance uuid 9c9bc278-9d35-4a42-b77f-579500fbdc0b {{(pid=118994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:05:31.326150 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-37a744ac-e6a2-433a-a7f6-338479195d10 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b/os-volume_attachments/8853a806-7092-4ee6-b0ec-8797085c117a" status: 202 len: 0 microversion: 2.1 time: 0.286363 Oct 11 12:05:31.327610 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 250/515] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Oct 11 12:05:31 2022] DELETE /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b/os-volume_attachments/8853a806-7092-4ee6-b0ec-8797085c117a => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 12:05:31.340189 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-32b75f2b-3bcd-44cb-a505-38ec5f003c42 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:31.350150 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-32b75f2b-3bcd-44cb-a505-38ec5f003c42 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1723 microversion: 2.1 time: 0.214720 Oct 11 12:05:31.351141 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 266/516] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:31 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1723 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:05:31.483335 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-1e26dc16-499c-4d7f-bda2-095016bf196b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:31.484036 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-1e26dc16-499c-4d7f-bda2-095016bf196b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:31.490762 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1e26dc16-499c-4d7f-bda2-095016bf196b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:31.491253 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1e26dc16-499c-4d7f-bda2-095016bf196b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:31.491680 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1e26dc16-499c-4d7f-bda2-095016bf196b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:31.492397 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1e26dc16-499c-4d7f-bda2-095016bf196b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:31.492824 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1e26dc16-499c-4d7f-bda2-095016bf196b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:31.493243 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1e26dc16-499c-4d7f-bda2-095016bf196b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:31.648903 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-1e26dc16-499c-4d7f-bda2-095016bf196b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:31.657605 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-1e26dc16-499c-4d7f-bda2-095016bf196b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1714 microversion: 2.1 time: 0.178576 Oct 11 12:05:31.658165 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 251/517] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:31 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1714 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:05:32.374095 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-bd1ab434-044d-4161-8c01-064476d1905b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:32.375616 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-bd1ab434-044d-4161-8c01-064476d1905b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:32.382742 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd1ab434-044d-4161-8c01-064476d1905b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:32.383112 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd1ab434-044d-4161-8c01-064476d1905b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:32.383595 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd1ab434-044d-4161-8c01-064476d1905b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:32.384300 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd1ab434-044d-4161-8c01-064476d1905b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:32.384755 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd1ab434-044d-4161-8c01-064476d1905b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:32.385347 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd1ab434-044d-4161-8c01-064476d1905b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:32.472861 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-a9851bab-435d-4d09-95bb-b7412e5f96e3 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:32.473496 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-a9851bab-435d-4d09-95bb-b7412e5f96e3 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 9c9bc278-9d35-4a42-b77f-579500fbdc0b] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:32.480220 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a9851bab-435d-4d09-95bb-b7412e5f96e3 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:32.480683 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a9851bab-435d-4d09-95bb-b7412e5f96e3 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:32.481310 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a9851bab-435d-4d09-95bb-b7412e5f96e3 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:32.482008 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a9851bab-435d-4d09-95bb-b7412e5f96e3 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:32.482438 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a9851bab-435d-4d09-95bb-b7412e5f96e3 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:32.482899 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a9851bab-435d-4d09-95bb-b7412e5f96e3 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:32.516252 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-a9851bab-435d-4d09-95bb-b7412e5f96e3 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 9c9bc278-9d35-4a42-b77f-579500fbdc0b] Going to try to terminate instance {{(pid=118994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 12:05:32.536500 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-bd1ab434-044d-4161-8c01-064476d1905b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:32.548315 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-bd1ab434-044d-4161-8c01-064476d1905b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1723 microversion: 2.1 time: 0.178181 Oct 11 12:05:32.548958 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 267/518] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:32 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:32.603083 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-a9851bab-435d-4d09-95bb-b7412e5f96e3 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "DELETE /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b" status: 204 len: 0 microversion: 2.1 time: 0.133744 Oct 11 12:05:32.603768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 252/519] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Oct 11 12:05:32 2022] DELETE /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 12:05:32.612469 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9cb533f9-e713-4803-a423-4edbb40ca3f6 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:32.613069 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9cb533f9-e713-4803-a423-4edbb40ca3f6 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 9c9bc278-9d35-4a42-b77f-579500fbdc0b] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:32.619182 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9cb533f9-e713-4803-a423-4edbb40ca3f6 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:32.619655 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9cb533f9-e713-4803-a423-4edbb40ca3f6 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:32.620081 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9cb533f9-e713-4803-a423-4edbb40ca3f6 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:32.620760 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9cb533f9-e713-4803-a423-4edbb40ca3f6 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:32.621205 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9cb533f9-e713-4803-a423-4edbb40ca3f6 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:32.621611 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9cb533f9-e713-4803-a423-4edbb40ca3f6 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:32.762879 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-9cb533f9-e713-4803-a423-4edbb40ca3f6 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:32.771860 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9cb533f9-e713-4803-a423-4edbb40ca3f6 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b" status: 200 len: 1513 microversion: 2.1 time: 0.163111 Oct 11 12:05:32.772434 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 268/520] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:32 2022] GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:05:33.573473 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-bdeff0cf-7a7e-47c6-8f0c-fa9595d92984 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:33.574369 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-bdeff0cf-7a7e-47c6-8f0c-fa9595d92984 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:33.581669 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bdeff0cf-7a7e-47c6-8f0c-fa9595d92984 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:33.582152 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bdeff0cf-7a7e-47c6-8f0c-fa9595d92984 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:33.582606 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bdeff0cf-7a7e-47c6-8f0c-fa9595d92984 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:33.583307 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bdeff0cf-7a7e-47c6-8f0c-fa9595d92984 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:33.583770 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bdeff0cf-7a7e-47c6-8f0c-fa9595d92984 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:33.584194 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bdeff0cf-7a7e-47c6-8f0c-fa9595d92984 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:33.725180 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-bdeff0cf-7a7e-47c6-8f0c-fa9595d92984 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:33.734671 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-bdeff0cf-7a7e-47c6-8f0c-fa9595d92984 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1723 microversion: 2.1 time: 0.165564 Oct 11 12:05:33.735366 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 253/521] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:33 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:33.795699 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-1499b4cd-3c58-4c1b-a7b2-3a3e9a0a54a0 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:33.796324 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-1499b4cd-3c58-4c1b-a7b2-3a3e9a0a54a0 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 9c9bc278-9d35-4a42-b77f-579500fbdc0b] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:33.803384 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1499b4cd-3c58-4c1b-a7b2-3a3e9a0a54a0 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:33.803869 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1499b4cd-3c58-4c1b-a7b2-3a3e9a0a54a0 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:33.804297 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1499b4cd-3c58-4c1b-a7b2-3a3e9a0a54a0 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:33.804998 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1499b4cd-3c58-4c1b-a7b2-3a3e9a0a54a0 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:33.805443 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1499b4cd-3c58-4c1b-a7b2-3a3e9a0a54a0 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:33.805861 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1499b4cd-3c58-4c1b-a7b2-3a3e9a0a54a0 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:33.939052 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-1499b4cd-3c58-4c1b-a7b2-3a3e9a0a54a0 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:33.947667 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-1499b4cd-3c58-4c1b-a7b2-3a3e9a0a54a0 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b" status: 200 len: 1513 microversion: 2.1 time: 0.155818 Oct 11 12:05:33.948258 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 269/522] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:33 2022] GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:34.758507 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-4442d321-27cb-4c71-b2e6-2d5303f8d60f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:34.759206 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-4442d321-27cb-4c71-b2e6-2d5303f8d60f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:34.766441 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4442d321-27cb-4c71-b2e6-2d5303f8d60f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:34.766940 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4442d321-27cb-4c71-b2e6-2d5303f8d60f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:34.767369 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4442d321-27cb-4c71-b2e6-2d5303f8d60f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:34.768186 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4442d321-27cb-4c71-b2e6-2d5303f8d60f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:34.768641 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4442d321-27cb-4c71-b2e6-2d5303f8d60f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:34.769085 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4442d321-27cb-4c71-b2e6-2d5303f8d60f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:34.906172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-4442d321-27cb-4c71-b2e6-2d5303f8d60f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:34.914864 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-4442d321-27cb-4c71-b2e6-2d5303f8d60f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1723 microversion: 2.1 time: 0.160342 Oct 11 12:05:34.915467 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 254/523] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:34 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:34.971530 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-625289cf-dfc0-40b4-b43b-d9b3e51f5530 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:34.972134 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-625289cf-dfc0-40b4-b43b-d9b3e51f5530 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 9c9bc278-9d35-4a42-b77f-579500fbdc0b] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:34.978822 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-625289cf-dfc0-40b4-b43b-d9b3e51f5530 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:34.979297 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-625289cf-dfc0-40b4-b43b-d9b3e51f5530 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:34.979725 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-625289cf-dfc0-40b4-b43b-d9b3e51f5530 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:34.980406 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-625289cf-dfc0-40b4-b43b-d9b3e51f5530 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:34.980851 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-625289cf-dfc0-40b4-b43b-d9b3e51f5530 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:34.981280 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-625289cf-dfc0-40b4-b43b-d9b3e51f5530 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:35.122971 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-625289cf-dfc0-40b4-b43b-d9b3e51f5530 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:35.131422 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-625289cf-dfc0-40b4-b43b-d9b3e51f5530 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b" status: 200 len: 1513 microversion: 2.1 time: 0.163861 Oct 11 12:05:35.132041 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 270/524] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:34 2022] GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:35.941155 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-2ff6c757-5538-4b71-86da-6a6ddce0329a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:35.941768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-2ff6c757-5538-4b71-86da-6a6ddce0329a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:35.948522 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2ff6c757-5538-4b71-86da-6a6ddce0329a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:35.949005 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2ff6c757-5538-4b71-86da-6a6ddce0329a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:35.949436 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2ff6c757-5538-4b71-86da-6a6ddce0329a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:35.950125 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2ff6c757-5538-4b71-86da-6a6ddce0329a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:35.950582 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2ff6c757-5538-4b71-86da-6a6ddce0329a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:35.951024 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2ff6c757-5538-4b71-86da-6a6ddce0329a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:36.095099 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-2ff6c757-5538-4b71-86da-6a6ddce0329a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:36.104166 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-2ff6c757-5538-4b71-86da-6a6ddce0329a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1723 microversion: 2.1 time: 0.168701 Oct 11 12:05:36.104966 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 255/525] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:35 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:36.157081 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-4e628ddc-82b2-4c7b-b0d1-a0f5211d3037 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:36.157699 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-4e628ddc-82b2-4c7b-b0d1-a0f5211d3037 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 9c9bc278-9d35-4a42-b77f-579500fbdc0b] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:36.165293 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4e628ddc-82b2-4c7b-b0d1-a0f5211d3037 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:36.165775 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4e628ddc-82b2-4c7b-b0d1-a0f5211d3037 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:36.166206 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4e628ddc-82b2-4c7b-b0d1-a0f5211d3037 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:36.166943 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4e628ddc-82b2-4c7b-b0d1-a0f5211d3037 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:36.167364 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4e628ddc-82b2-4c7b-b0d1-a0f5211d3037 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:36.167782 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4e628ddc-82b2-4c7b-b0d1-a0f5211d3037 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:36.319483 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-4e628ddc-82b2-4c7b-b0d1-a0f5211d3037 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:36.328412 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-4e628ddc-82b2-4c7b-b0d1-a0f5211d3037 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b" status: 200 len: 1513 microversion: 2.1 time: 0.175237 Oct 11 12:05:36.328995 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 271/526] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:36 2022] GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:37.126797 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-20dda1c8-206a-4202-88da-999060e24dda tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:37.127483 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-20dda1c8-206a-4202-88da-999060e24dda tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:37.134147 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-20dda1c8-206a-4202-88da-999060e24dda tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:37.134653 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-20dda1c8-206a-4202-88da-999060e24dda tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:37.135086 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-20dda1c8-206a-4202-88da-999060e24dda tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:37.135772 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-20dda1c8-206a-4202-88da-999060e24dda tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:37.136213 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-20dda1c8-206a-4202-88da-999060e24dda tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:37.136624 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-20dda1c8-206a-4202-88da-999060e24dda tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:37.272437 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-20dda1c8-206a-4202-88da-999060e24dda tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:37.281365 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-20dda1c8-206a-4202-88da-999060e24dda tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1729 microversion: 2.1 time: 0.158482 Oct 11 12:05:37.282117 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 256/527] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:37 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:37.305839 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-c0eff943-809a-4555-9677-a89761f9d2df tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:37.306334 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-c0eff943-809a-4555-9677-a89761f9d2df tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:37.312727 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c0eff943-809a-4555-9677-a89761f9d2df tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:37.313379 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c0eff943-809a-4555-9677-a89761f9d2df tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:37.314487 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c0eff943-809a-4555-9677-a89761f9d2df tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:37.314660 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c0eff943-809a-4555-9677-a89761f9d2df tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:37.315006 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c0eff943-809a-4555-9677-a89761f9d2df tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:37.315415 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c0eff943-809a-4555-9677-a89761f9d2df tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:37.354074 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-aa0e477c-52cc-488c-a53c-748dcaf531c5 req-30cbbe1f-5c38-4060-95df-fa2a374fb6de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c9bc278-9d35-4a42-b77f-579500fbdc0b", "name": "network-vif-deleted", "tag": "2dac5a27-b37e-49f8-b3e7-c0e108ff36e9"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:05:37.364079 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-aa0e477c-52cc-488c-a53c-748dcaf531c5 req-30cbbe1f-5c38-4060-95df-fa2a374fb6de service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:37.364551 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-aa0e477c-52cc-488c-a53c-748dcaf531c5 req-30cbbe1f-5c38-4060-95df-fa2a374fb6de service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:37.365003 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-aa0e477c-52cc-488c-a53c-748dcaf531c5 req-30cbbe1f-5c38-4060-95df-fa2a374fb6de service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:37.376947 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-aa0e477c-52cc-488c-a53c-748dcaf531c5 req-30cbbe1f-5c38-4060-95df-fa2a374fb6de service nova] Creating event network-vif-deleted:2dac5a27-b37e-49f8-b3e7-c0e108ff36e9 for instance 9c9bc278-9d35-4a42-b77f-579500fbdc0b on hv-cinder-82099 Oct 11 12:05:37.381903 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-aa0e477c-52cc-488c-a53c-748dcaf531c5 req-30cbbe1f-5c38-4060-95df-fa2a374fb6de service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095172 Oct 11 12:05:37.383112 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 272/528] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:05:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:05:37.389444 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9320e25d-1934-43d4-beef-ae9ed7510f6c tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:37.390366 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9320e25d-1934-43d4-beef-ae9ed7510f6c tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 9c9bc278-9d35-4a42-b77f-579500fbdc0b] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:37.397541 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9320e25d-1934-43d4-beef-ae9ed7510f6c tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:37.398365 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9320e25d-1934-43d4-beef-ae9ed7510f6c tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:37.398825 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9320e25d-1934-43d4-beef-ae9ed7510f6c tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:37.399524 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9320e25d-1934-43d4-beef-ae9ed7510f6c tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:37.399971 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9320e25d-1934-43d4-beef-ae9ed7510f6c tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:37.400245 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-c0eff943-809a-4555-9677-a89761f9d2df tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099015 Oct 11 12:05:37.400387 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9320e25d-1934-43d4-beef-ae9ed7510f6c tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:37.400853 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 257/529] 10.222.0.59 () {58 vars in 1275 bytes} [Tue Oct 11 12:05:37 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:05:37.486485 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-9320e25d-1934-43d4-beef-ae9ed7510f6c tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:37.497218 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9320e25d-1934-43d4-beef-ae9ed7510f6c tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b" status: 200 len: 1304 microversion: 2.1 time: 0.112695 Oct 11 12:05:37.497786 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 273/530] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:37 2022] GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b => generated 1304 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:38.521720 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-ef6f4db9-5b07-432d-b4e1-9cde6a3a9bf7 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:38.522604 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-ef6f4db9-5b07-432d-b4e1-9cde6a3a9bf7 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 9c9bc278-9d35-4a42-b77f-579500fbdc0b] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:38.528720 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ef6f4db9-5b07-432d-b4e1-9cde6a3a9bf7 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:38.529191 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ef6f4db9-5b07-432d-b4e1-9cde6a3a9bf7 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:38.529621 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ef6f4db9-5b07-432d-b4e1-9cde6a3a9bf7 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:38.530317 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ef6f4db9-5b07-432d-b4e1-9cde6a3a9bf7 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:38.530788 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ef6f4db9-5b07-432d-b4e1-9cde6a3a9bf7 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:38.531202 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ef6f4db9-5b07-432d-b4e1-9cde6a3a9bf7 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:38.547039 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.wsgi [None req-ef6f4db9-5b07-432d-b4e1-9cde6a3a9bf7 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] HTTP exception thrown: Instance 9c9bc278-9d35-4a42-b77f-579500fbdc0b could not be found. Oct 11 12:05:38.549110 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-ef6f4db9-5b07-432d-b4e1-9cde6a3a9bf7 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Request method failure captured: Oct 11 12:05:38.549110 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: request: GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b HTTP/1.1 Oct 11 12:05:38.549110 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept: application/json Oct 11 12:05:38.549110 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept-Encoding: identity Oct 11 12:05:38.549110 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Connection: close Oct 11 12:05:38.549110 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Length: 0 Oct 11 12:05:38.549110 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Type: application/json Oct 11 12:05:38.549110 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Host: 10.222.0.59 Oct 11 12:05:38.549110 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Openstack-System-Scope: None Oct 11 12:05:38.549110 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: User-Agent: python-urllib3/1.26.12 Oct 11 12:05:38.549110 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Auth-Token: gAAAAABjRVvEdzTO9RqoFFtPibLTQtcVJuJ41DpE_-zCst6bSGcdD8kbO1B7xVW2cJ-zXn7Bdd24eFv4Gm8-4tWxH0yPhAMpX7c6vIIt_bvUUfABRZ7H0xGXawppWtsxmFuKR-7y3vXqe9XAFY0C_kUaI1fBNIURobKJYYFBpib0WrRm7_mAPtI Oct 11 12:05:38.549110 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Id: None Oct 11 12:05:38.549110 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Name: None Oct 11 12:05:38.549110 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Identity-Status: Confirmed Oct 11 12:05:38.549110 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Is-Admin-Project: True Oct 11 12:05:38.549110 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Id: default Oct 11 12:05:38.549110 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Name: Default Oct 11 12:05:38.549110 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Id: 8908fef147b141b088ec5d458112e624 Oct 11 12:05:38.549110 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1962236174 Oct 11 12:05:38.549110 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Role: reader,member Oct 11 12:05:38.549110 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Roles: reader,member Oct 11 12:05:38.550483 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8908fef147b141b088ec5d458112e624"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8908fef147b141b088ec5d458112e624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8908fef147b141b088ec5d458112e624"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8908fef147b141b088ec5d458112e624"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:05:38.550483 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant: tempest-VolumesSnapshotTestJSON-1962236174 Oct 11 12:05:38.550483 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Id: 8908fef147b141b088ec5d458112e624 Oct 11 12:05:38.550483 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1962236174 Oct 11 12:05:38.550483 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User: tempest-VolumesSnapshotTestJSON-1962236174-project Oct 11 12:05:38.550483 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Id: default Oct 11 12:05:38.550483 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Name: Default Oct 11 12:05:38.550483 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Id: e4e098a260b94b2089801f02bdb0b126 Oct 11 12:05:38.550483 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Name: tempest-VolumesSnapshotTestJSON-1962236174-project Oct 11 12:05:38.550483 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: method: > Oct 11 12:05:38.550483 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: exception: Instance 9c9bc278-9d35-4a42-b77f-579500fbdc0b could not be found. Oct 11 12:05:38.550483 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: action_args: {'id': '9c9bc278-9d35-4a42-b77f-579500fbdc0b'} Oct 11 12:05:38.551318 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:05:38.551318 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:05:38.551318 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:05:38.551318 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:05:38.551318 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:05:38.551318 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:05:38.551318 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:05:38.551318 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:05:38.551318 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:05:38.551318 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:05:38.551318 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c9bc278-9d35-4a42-b77f-579500fbdc0b could not be found. Oct 11 12:05:38.551318 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:05:38.551318 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:05:38.551318 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:05:38.551318 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:05:38.551318 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:05:38.551318 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:05:38.551318 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:05:38.551318 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:05:38.551318 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:05:38.552495 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:05:38.552495 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 12:05:38.552495 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 12:05:38.552495 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:05:38.552495 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:05:38.552495 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:05:38.552495 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:05:38.552495 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c9bc278-9d35-4a42-b77f-579500fbdc0b could not be found. Oct 11 12:05:38.552495 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:05:38.552495 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:05:38.552495 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:05:38.552495 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:05:38.552495 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:05:38.552495 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:05:38.552495 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:05:38.552495 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:05:38.552495 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c9bc278-9d35-4a42-b77f-579500fbdc0b could not be found. Oct 11 12:05:38.552495 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:05:38.553555 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-ef6f4db9-5b07-432d-b4e1-9cde6a3a9bf7 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Returning 404 to user: Instance 9c9bc278-9d35-4a42-b77f-579500fbdc0b could not be found. {{(pid=118994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:05:38.553555 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-ef6f4db9-5b07-432d-b4e1-9cde6a3a9bf7 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b" status: 404 len: 111 microversion: 2.1 time: 0.034186 Oct 11 12:05:38.553555 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 258/531] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:38 2022] GET /compute/v2.1/servers/9c9bc278-9d35-4a42-b77f-579500fbdc0b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:05:39.399822 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-9c44c87e-51c2-4d12-8435-d3b91ba78979 req-5191a74a-1d9e-41bb-a5a6-3b57635aeffe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1be649cc-66ab-45f6-8477-19a7263944fa", "tag": "264946f8-afe2-4e00-bb9a-a5a0027ee444"}, {"name": "network-changed", "server_uuid": "1be649cc-66ab-45f6-8477-19a7263944fa", "tag": "264946f8-afe2-4e00-bb9a-a5a0027ee444"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:05:39.410070 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-9c44c87e-51c2-4d12-8435-d3b91ba78979 req-5191a74a-1d9e-41bb-a5a6-3b57635aeffe service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:39.410526 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-9c44c87e-51c2-4d12-8435-d3b91ba78979 req-5191a74a-1d9e-41bb-a5a6-3b57635aeffe service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:39.410974 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-9c44c87e-51c2-4d12-8435-d3b91ba78979 req-5191a74a-1d9e-41bb-a5a6-3b57635aeffe service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:39.421838 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-9c44c87e-51c2-4d12-8435-d3b91ba78979 req-5191a74a-1d9e-41bb-a5a6-3b57635aeffe service nova] Creating event network-changed:264946f8-afe2-4e00-bb9a-a5a0027ee444 for instance 1be649cc-66ab-45f6-8477-19a7263944fa on hv-cinder-82099 Oct 11 12:05:39.422331 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-9c44c87e-51c2-4d12-8435-d3b91ba78979 req-5191a74a-1d9e-41bb-a5a6-3b57635aeffe service nova] Creating event network-changed:264946f8-afe2-4e00-bb9a-a5a0027ee444 for instance 1be649cc-66ab-45f6-8477-19a7263944fa on hv-cinder-82099 Oct 11 12:05:39.427427 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-9c44c87e-51c2-4d12-8435-d3b91ba78979 req-5191a74a-1d9e-41bb-a5a6-3b57635aeffe service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.031671 Oct 11 12:05:39.427989 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 274/532] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:05:39 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:05:49.543050 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-a1af1ede-cce6-46ee-beb9-0b0b56270587 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1498630169", "imageRef": "09bcc8f8-a32f-4ec8-9ab2-a98964ad6a01", "flavorRef": "452", "networks": [{"uuid": "f052a03b-9e17-4e41-b7c3-9530b5963021"}]}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:05:49.556191 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:05:49.556912 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:05:49.608975 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.network.neutron [None req-a1af1ede-cce6-46ee-beb9-0b0b56270587 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] validate_networks() for [('f052a03b-9e17-4e41-b7c3-9530b5963021', None, None, None, None, None)] {{(pid=118994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 12:05:50.046422 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-a1af1ede-cce6-46ee-beb9-0b0b56270587 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Flavor limits 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 12:05:50.046862 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-a1af1ede-cce6-46ee-beb9-0b0b56270587 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Image limits 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 12:05:50.047327 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-a1af1ede-cce6-46ee-beb9-0b0b56270587 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Flavor pref 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 12:05:50.047724 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-a1af1ede-cce6-46ee-beb9-0b0b56270587 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Image pref 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 12:05:50.048126 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-a1af1ede-cce6-46ee-beb9-0b0b56270587 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 12:05:50.057768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a1af1ede-cce6-46ee-beb9-0b0b56270587 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:50.058241 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a1af1ede-cce6-46ee-beb9-0b0b56270587 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:50.058709 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a1af1ede-cce6-46ee-beb9-0b0b56270587 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:50.059417 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a1af1ede-cce6-46ee-beb9-0b0b56270587 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:50.059859 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a1af1ede-cce6-46ee-beb9-0b0b56270587 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:50.060270 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a1af1ede-cce6-46ee-beb9-0b0b56270587 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:50.078163 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-a1af1ede-cce6-46ee-beb9-0b0b56270587 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Getting quotas for project 8908fef147b141b088ec5d458112e624. Resources: {'ram', 'instances', 'cores'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 12:05:50.082886 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-a1af1ede-cce6-46ee-beb9-0b0b56270587 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Getting quotas for user e4e098a260b94b2089801f02bdb0b126 and project 8908fef147b141b088ec5d458112e624. Resources: {'ram', 'instances', 'cores'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 12:05:50.098497 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-a1af1ede-cce6-46ee-beb9-0b0b56270587 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Going to run 1 instances... {{(pid=118994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 12:05:50.100869 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-a1af1ede-cce6-46ee-beb9-0b0b56270587 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 5704b491-32a8-464f-8af0-ade817102262] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09bcc8f8-a32f-4ec8-9ab2-a98964ad6a01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 12:05:50.153235 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-a1af1ede-cce6-46ee-beb9-0b0b56270587 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.616169 Oct 11 12:05:50.154125 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 259/533] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Oct 11 12:05:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 618 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 12:05:50.163612 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=29 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:05:50.164784 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:05:50.168970 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-cea04a3b-6d04-4f20-b4e0-d373a787f8ae tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:50.169662 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-cea04a3b-6d04-4f20-b4e0-d373a787f8ae tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 5704b491-32a8-464f-8af0-ade817102262] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:50.242531 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-cea04a3b-6d04-4f20-b4e0-d373a787f8ae tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:50.249756 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-cea04a3b-6d04-4f20-b4e0-d373a787f8ae tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262" status: 200 len: 1219 microversion: 2.1 time: 0.087974 Oct 11 12:05:50.255131 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 275/534] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:50 2022] GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:51.273101 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-e84d1c38-5173-4ff4-b2b6-53c571a550ef tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:51.273756 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-e84d1c38-5173-4ff4-b2b6-53c571a550ef tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 5704b491-32a8-464f-8af0-ade817102262] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:51.281414 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e84d1c38-5173-4ff4-b2b6-53c571a550ef tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:51.281894 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e84d1c38-5173-4ff4-b2b6-53c571a550ef tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:51.282328 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e84d1c38-5173-4ff4-b2b6-53c571a550ef tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:51.283035 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e84d1c38-5173-4ff4-b2b6-53c571a550ef tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:51.283498 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e84d1c38-5173-4ff4-b2b6-53c571a550ef tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:51.283914 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e84d1c38-5173-4ff4-b2b6-53c571a550ef tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:51.351939 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-e84d1c38-5173-4ff4-b2b6-53c571a550ef tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:51.360330 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-e84d1c38-5173-4ff4-b2b6-53c571a550ef tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262" status: 200 len: 1271 microversion: 2.1 time: 0.091511 Oct 11 12:05:51.360912 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 260/535] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:51 2022] GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262 => generated 1271 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:52.388359 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c4ef1061-8095-4cc3-b77c-6a53810c4d3e tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:52.389029 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c4ef1061-8095-4cc3-b77c-6a53810c4d3e tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 5704b491-32a8-464f-8af0-ade817102262] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:52.397053 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c4ef1061-8095-4cc3-b77c-6a53810c4d3e tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:52.397706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c4ef1061-8095-4cc3-b77c-6a53810c4d3e tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:52.398206 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c4ef1061-8095-4cc3-b77c-6a53810c4d3e tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:52.399041 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c4ef1061-8095-4cc3-b77c-6a53810c4d3e tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:52.399589 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c4ef1061-8095-4cc3-b77c-6a53810c4d3e tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:52.400080 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c4ef1061-8095-4cc3-b77c-6a53810c4d3e tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:52.624234 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c4ef1061-8095-4cc3-b77c-6a53810c4d3e tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:52.633347 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c4ef1061-8095-4cc3-b77c-6a53810c4d3e tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262" status: 200 len: 1319 microversion: 2.1 time: 0.253209 Oct 11 12:05:52.633846 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 276/536] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:52 2022] GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:05:52.823554 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-343973bd-e821-42df-bbcb-dd8a5b4c8b86 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:52.824169 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-343973bd-e821-42df-bbcb-dd8a5b4c8b86 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 4fb48466-ddf3-47f7-bade-b20976690c7f] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:52.830817 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-343973bd-e821-42df-bbcb-dd8a5b4c8b86 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:52.831427 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-343973bd-e821-42df-bbcb-dd8a5b4c8b86 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:52.832037 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-343973bd-e821-42df-bbcb-dd8a5b4c8b86 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:52.832845 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-343973bd-e821-42df-bbcb-dd8a5b4c8b86 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:52.833312 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-343973bd-e821-42df-bbcb-dd8a5b4c8b86 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:52.833732 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-343973bd-e821-42df-bbcb-dd8a5b4c8b86 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:52.861357 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-343973bd-e821-42df-bbcb-dd8a5b4c8b86 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f/ips" status: 200 len: 151 microversion: 2.1 time: 0.187062 Oct 11 12:05:52.862242 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 261/537] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Oct 11 12:05:52 2022] GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f/ips => generated 151 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:05:52.880781 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b8e1da8a-06f7-44d8-a821-35934547d954 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "47160c47-8ad8-4adc-8e54-750c06977f12"}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:05:52.885705 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-b8e1da8a-06f7-44d8-a821-35934547d954 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 4fb48466-ddf3-47f7-bade-b20976690c7f] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:52.896552 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b8e1da8a-06f7-44d8-a821-35934547d954 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:52.897394 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b8e1da8a-06f7-44d8-a821-35934547d954 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:52.898203 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b8e1da8a-06f7-44d8-a821-35934547d954 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:52.899515 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b8e1da8a-06f7-44d8-a821-35934547d954 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:52.900388 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b8e1da8a-06f7-44d8-a821-35934547d954 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:52.901140 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b8e1da8a-06f7-44d8-a821-35934547d954 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:53.012587 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-b8e1da8a-06f7-44d8-a821-35934547d954 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] HTTP exception thrown: Invalid volume: volume 47160c47-8ad8-4adc-8e54-750c06977f12 is already attached to instances: ac5dba27-8c1b-4760-ad6f-7ab81244e186 Oct 11 12:05:53.015020 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b8e1da8a-06f7-44d8-a821-35934547d954 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Request method failure captured: Oct 11 12:05:53.015020 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: request: POST /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f/os-volume_attachments HTTP/1.1 Oct 11 12:05:53.015020 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 11 12:05:53.015020 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 11 12:05:53.015020 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Connection: close Oct 11 12:05:53.015020 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Length: 74 Oct 11 12:05:53.015020 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 11 12:05:53.015020 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Host: 10.222.0.59 Oct 11 12:05:53.015020 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 11 12:05:53.015020 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 11 12:05:53.015020 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjRVrDbBzKTyV9eZUXZryLVe-KpT4WYEHJaER5TFyRAvTSEg5lw7FxKmfGi17rpAnxooOQ2r63AULbLGHHY4hm760kGTTUbeHuyR9-shGVTsiYjly6leZlsPXT8VYCrZ-E0QA-DYApJOgvSEAYz3JHEXcb3Qg12yFjALYOMVuEZNDDhBk Oct 11 12:05:53.015020 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 11 12:05:53.015020 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 11 12:05:53.015020 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 11 12:05:53.015020 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 11 12:05:53.015020 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 11 12:05:53.015020 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 11 12:05:53.015020 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Id: c83f971a0ae04288a5c6dc87d3370979 Oct 11 12:05:53.015020 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:05:53.015020 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Role: reader,member Oct 11 12:05:53.015020 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Roles: reader,member Oct 11 12:05:53.016634 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:05:53.016634 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:05:53.016634 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Id: c83f971a0ae04288a5c6dc87d3370979 Oct 11 12:05:53.016634 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:05:53.016634 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User: tempest-AttachVolumeNegativeTest-1543839758-project Oct 11 12:05:53.016634 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 11 12:05:53.016634 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 11 12:05:53.016634 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Id: 41d3680dda7c4cc8aeb6d086efca0775 Oct 11 12:05:53.016634 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-AttachVolumeNegativeTest-1543839758-project Oct 11 12:05:53.016634 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Oct 11 12:05:53.016634 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {"volumeAttachment": {"volumeId": "47160c47-8ad8-4adc-8e54-750c06977f12"}} Oct 11 12:05:53.016634 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: method: > Oct 11 12:05:53.018012 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: exception: Invalid volume: volume 47160c47-8ad8-4adc-8e54-750c06977f12 is already attached to instances: ac5dba27-8c1b-4760-ad6f-7ab81244e186 Oct 11 12:05:53.018012 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: action_args: {'server_id': '4fb48466-ddf3-47f7-bade-b20976690c7f', 'body': {'volumeAttachment': {'volumeId': '47160c47-8ad8-4adc-8e54-750c06977f12'}}} Oct 11 12:05:53.018012 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:05:53.018012 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:05:53.018012 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 11 12:05:53.018012 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 11 12:05:53.018012 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 12:05:53.018012 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 12:05:53.018012 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 11 12:05:53.018012 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 12:05:53.018012 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 11 12:05:53.018012 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 11 12:05:53.018012 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 11 12:05:53.018012 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 11 12:05:53.018012 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 47160c47-8ad8-4adc-8e54-750c06977f12 is already attached to instances: ac5dba27-8c1b-4760-ad6f-7ab81244e186 Oct 11 12:05:53.018012 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:05:53.018012 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:05:53.018012 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:05:53.018012 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:05:53.019883 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:05:53.019883 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:05:53.019883 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:05:53.019883 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:05:53.019883 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:05:53.019883 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:05:53.019883 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 12:05:53.019883 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 12:05:53.019883 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 12:05:53.019883 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 12:05:53.019883 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 12:05:53.019883 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 12:05:53.019883 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 11 12:05:53.019883 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 11 12:05:53.019883 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 47160c47-8ad8-4adc-8e54-750c06977f12 is already attached to instances: ac5dba27-8c1b-4760-ad6f-7ab81244e186 Oct 11 12:05:53.019883 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:05:53.019883 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:05:53.019883 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:05:53.019883 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:05:53.019883 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:05:53.021976 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:05:53.021976 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:05:53.021976 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:05:53.021976 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 47160c47-8ad8-4adc-8e54-750c06977f12 is already attached to instances: ac5dba27-8c1b-4760-ad6f-7ab81244e186 Oct 11 12:05:53.021976 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:05:53.021976 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b8e1da8a-06f7-44d8-a821-35934547d954 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Returning 400 to user: Invalid volume: volume 47160c47-8ad8-4adc-8e54-750c06977f12 is already attached to instances: ac5dba27-8c1b-4760-ad6f-7ab81244e186 {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:05:53.021976 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b8e1da8a-06f7-44d8-a821-35934547d954 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "POST /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.143625 Oct 11 12:05:53.021976 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 277/538] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Oct 11 12:05:52 2022] POST /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f/os-volume_attachments => generated 174 bytes in 146 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 12:05:53.029603 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-ca1df7a3-6884-411a-98a6-a760d6203b7c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:53.030194 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-ca1df7a3-6884-411a-98a6-a760d6203b7c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 4fb48466-ddf3-47f7-bade-b20976690c7f] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:53.041052 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ca1df7a3-6884-411a-98a6-a760d6203b7c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:53.041948 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ca1df7a3-6884-411a-98a6-a760d6203b7c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:53.042797 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ca1df7a3-6884-411a-98a6-a760d6203b7c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:53.044134 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ca1df7a3-6884-411a-98a6-a760d6203b7c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:53.045002 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ca1df7a3-6884-411a-98a6-a760d6203b7c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:53.046016 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ca1df7a3-6884-411a-98a6-a760d6203b7c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:53.085554 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-ca1df7a3-6884-411a-98a6-a760d6203b7c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 4fb48466-ddf3-47f7-bade-b20976690c7f] Going to try to terminate instance {{(pid=118994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 12:05:53.177277 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-ca1df7a3-6884-411a-98a6-a760d6203b7c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f" status: 204 len: 0 microversion: 2.1 time: 0.152227 Oct 11 12:05:53.178799 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 262/539] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Oct 11 12:05:53 2022] DELETE /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 12:05:53.188697 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-cfeba1ac-65b1-450e-8b11-b537d2a3a079 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:53.189373 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-cfeba1ac-65b1-450e-8b11-b537d2a3a079 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 4fb48466-ddf3-47f7-bade-b20976690c7f] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:53.197733 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cfeba1ac-65b1-450e-8b11-b537d2a3a079 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:53.198236 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cfeba1ac-65b1-450e-8b11-b537d2a3a079 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:53.198718 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cfeba1ac-65b1-450e-8b11-b537d2a3a079 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:53.199690 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cfeba1ac-65b1-450e-8b11-b537d2a3a079 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:53.200161 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cfeba1ac-65b1-450e-8b11-b537d2a3a079 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:53.200591 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cfeba1ac-65b1-450e-8b11-b537d2a3a079 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:53.264080 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-c9baedb7-29ed-4c82-abe1-90c3e2e98870 req-e8227736-7b14-4361-b484-0be78b6b452f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5704b491-32a8-464f-8af0-ade817102262", "tag": "813f82ae-ef0d-47c9-aebf-259b5e1e87b2"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:05:53.275107 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-c9baedb7-29ed-4c82-abe1-90c3e2e98870 req-e8227736-7b14-4361-b484-0be78b6b452f service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:53.275673 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-c9baedb7-29ed-4c82-abe1-90c3e2e98870 req-e8227736-7b14-4361-b484-0be78b6b452f service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:53.276173 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-c9baedb7-29ed-4c82-abe1-90c3e2e98870 req-e8227736-7b14-4361-b484-0be78b6b452f service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:53.289024 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-c9baedb7-29ed-4c82-abe1-90c3e2e98870 req-e8227736-7b14-4361-b484-0be78b6b452f service nova] Creating event network-changed:813f82ae-ef0d-47c9-aebf-259b5e1e87b2 for instance 5704b491-32a8-464f-8af0-ade817102262 on hv-cinder-82099 Oct 11 12:05:53.294395 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-c9baedb7-29ed-4c82-abe1-90c3e2e98870 req-e8227736-7b14-4361-b484-0be78b6b452f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034425 Oct 11 12:05:53.295149 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 263/540] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 12:05:53.660196 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-ea974c8d-4597-4677-a7d1-08f9a9fa20fa tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:53.661167 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-ea974c8d-4597-4677-a7d1-08f9a9fa20fa tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 5704b491-32a8-464f-8af0-ade817102262] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:53.673876 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ea974c8d-4597-4677-a7d1-08f9a9fa20fa tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:53.674785 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ea974c8d-4597-4677-a7d1-08f9a9fa20fa tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:53.675528 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ea974c8d-4597-4677-a7d1-08f9a9fa20fa tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:53.676759 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ea974c8d-4597-4677-a7d1-08f9a9fa20fa tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:53.676950 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-cfeba1ac-65b1-450e-8b11-b537d2a3a079 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:53.677553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ea974c8d-4597-4677-a7d1-08f9a9fa20fa tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:53.678348 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ea974c8d-4597-4677-a7d1-08f9a9fa20fa tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:53.685931 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-cfeba1ac-65b1-450e-8b11-b537d2a3a079 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f" status: 200 len: 1680 microversion: 2.1 time: 0.501430 Oct 11 12:05:53.686885 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 278/541] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:53 2022] GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f => generated 1680 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:53.850138 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-ea974c8d-4597-4677-a7d1-08f9a9fa20fa tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:53.859195 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-ea974c8d-4597-4677-a7d1-08f9a9fa20fa tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262" status: 200 len: 1319 microversion: 2.1 time: 0.202912 Oct 11 12:05:53.859847 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 264/542] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:53 2022] GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:05:54.709652 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-87146e41-85c0-4e3c-8d44-f6558296cbdd tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:54.710257 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-87146e41-85c0-4e3c-8d44-f6558296cbdd tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 4fb48466-ddf3-47f7-bade-b20976690c7f] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:54.717668 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-87146e41-85c0-4e3c-8d44-f6558296cbdd tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:54.718151 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-87146e41-85c0-4e3c-8d44-f6558296cbdd tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:54.718609 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-87146e41-85c0-4e3c-8d44-f6558296cbdd tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:54.719330 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-87146e41-85c0-4e3c-8d44-f6558296cbdd tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:54.719779 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-87146e41-85c0-4e3c-8d44-f6558296cbdd tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:54.720204 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-87146e41-85c0-4e3c-8d44-f6558296cbdd tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:54.884497 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-aa47ecb0-3fa0-47de-a2d0-b02e24ff7986 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:54.885505 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-aa47ecb0-3fa0-47de-a2d0-b02e24ff7986 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 5704b491-32a8-464f-8af0-ade817102262] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:54.894129 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-aa47ecb0-3fa0-47de-a2d0-b02e24ff7986 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:54.894833 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-aa47ecb0-3fa0-47de-a2d0-b02e24ff7986 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:54.895394 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-aa47ecb0-3fa0-47de-a2d0-b02e24ff7986 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:54.896638 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-aa47ecb0-3fa0-47de-a2d0-b02e24ff7986 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:54.897187 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-aa47ecb0-3fa0-47de-a2d0-b02e24ff7986 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:54.897717 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-aa47ecb0-3fa0-47de-a2d0-b02e24ff7986 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:54.941618 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-87146e41-85c0-4e3c-8d44-f6558296cbdd tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:54.951003 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-87146e41-85c0-4e3c-8d44-f6558296cbdd tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f" status: 200 len: 1680 microversion: 2.1 time: 0.245051 Oct 11 12:05:54.962600 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 279/543] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:54 2022] GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f => generated 1680 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:55.072381 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-aa47ecb0-3fa0-47de-a2d0-b02e24ff7986 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:55.080825 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-aa47ecb0-3fa0-47de-a2d0-b02e24ff7986 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262" status: 200 len: 1319 microversion: 2.1 time: 0.201828 Oct 11 12:05:55.081397 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 265/544] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:54 2022] GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:05:55.995895 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a0857867-25c9-49cb-b677-9128351192d2 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:55.997148 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a0857867-25c9-49cb-b677-9128351192d2 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 4fb48466-ddf3-47f7-bade-b20976690c7f] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:56.010009 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0857867-25c9-49cb-b677-9128351192d2 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:56.011086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0857867-25c9-49cb-b677-9128351192d2 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:56.011748 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0857867-25c9-49cb-b677-9128351192d2 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:56.012980 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0857867-25c9-49cb-b677-9128351192d2 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:56.013800 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0857867-25c9-49cb-b677-9128351192d2 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:56.014591 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0857867-25c9-49cb-b677-9128351192d2 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:56.114259 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-a53e78ec-0985-4b5c-bdc2-c632a8b9ef57 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:56.115236 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-a53e78ec-0985-4b5c-bdc2-c632a8b9ef57 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 5704b491-32a8-464f-8af0-ade817102262] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:56.124287 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a53e78ec-0985-4b5c-bdc2-c632a8b9ef57 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:56.124945 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a53e78ec-0985-4b5c-bdc2-c632a8b9ef57 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:56.125575 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a53e78ec-0985-4b5c-bdc2-c632a8b9ef57 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:56.126441 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a53e78ec-0985-4b5c-bdc2-c632a8b9ef57 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:56.127080 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a53e78ec-0985-4b5c-bdc2-c632a8b9ef57 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:56.127564 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a53e78ec-0985-4b5c-bdc2-c632a8b9ef57 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:56.353841 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-a53e78ec-0985-4b5c-bdc2-c632a8b9ef57 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:56.363983 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-a53e78ec-0985-4b5c-bdc2-c632a8b9ef57 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262" status: 200 len: 1319 microversion: 2.1 time: 0.253272 Oct 11 12:05:56.364970 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 266/545] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:56 2022] GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262 => generated 1319 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:05:56.410919 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a0857867-25c9-49cb-b677-9128351192d2 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:56.431984 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a0857867-25c9-49cb-b677-9128351192d2 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f" status: 200 len: 1680 microversion: 2.1 time: 0.443106 Oct 11 12:05:56.433500 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 280/546] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:55 2022] GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f => generated 1680 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:57.117604 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-e483d904-b059-4ed2-b3d5-2d0f2a0dcf45 req-ee9ccc6a-6d8b-45a2-975a-ddbf35907ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fb48466-ddf3-47f7-bade-b20976690c7f", "name": "network-vif-deleted", "tag": "69c4b54f-6212-491b-948d-48cf289c20da"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:05:57.134255 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-e483d904-b059-4ed2-b3d5-2d0f2a0dcf45 req-ee9ccc6a-6d8b-45a2-975a-ddbf35907ea6 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:57.134680 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-e483d904-b059-4ed2-b3d5-2d0f2a0dcf45 req-ee9ccc6a-6d8b-45a2-975a-ddbf35907ea6 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:57.135107 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-e483d904-b059-4ed2-b3d5-2d0f2a0dcf45 req-ee9ccc6a-6d8b-45a2-975a-ddbf35907ea6 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:57.148985 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-e483d904-b059-4ed2-b3d5-2d0f2a0dcf45 req-ee9ccc6a-6d8b-45a2-975a-ddbf35907ea6 service nova] Creating event network-vif-deleted:69c4b54f-6212-491b-948d-48cf289c20da for instance 4fb48466-ddf3-47f7-bade-b20976690c7f on hv-cinder-82099 Oct 11 12:05:57.154820 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-e483d904-b059-4ed2-b3d5-2d0f2a0dcf45 req-ee9ccc6a-6d8b-45a2-975a-ddbf35907ea6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043793 Oct 11 12:05:57.155433 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 267/547] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:05:57.399941 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b1d5e4ca-c5b0-4003-bfbc-46fd54cf0037 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:57.401339 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-b1d5e4ca-c5b0-4003-bfbc-46fd54cf0037 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 5704b491-32a8-464f-8af0-ade817102262] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:57.414767 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b1d5e4ca-c5b0-4003-bfbc-46fd54cf0037 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:57.415639 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b1d5e4ca-c5b0-4003-bfbc-46fd54cf0037 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:57.416405 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b1d5e4ca-c5b0-4003-bfbc-46fd54cf0037 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:57.417723 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b1d5e4ca-c5b0-4003-bfbc-46fd54cf0037 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:57.418550 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b1d5e4ca-c5b0-4003-bfbc-46fd54cf0037 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:57.419356 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b1d5e4ca-c5b0-4003-bfbc-46fd54cf0037 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:57.474422 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-a56d6288-dfb5-404d-8a76-8dc3ce3e22af tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:57.476572 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-a56d6288-dfb5-404d-8a76-8dc3ce3e22af tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 4fb48466-ddf3-47f7-bade-b20976690c7f] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:57.491006 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a56d6288-dfb5-404d-8a76-8dc3ce3e22af tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:57.491867 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a56d6288-dfb5-404d-8a76-8dc3ce3e22af tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:57.492833 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a56d6288-dfb5-404d-8a76-8dc3ce3e22af tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:57.494090 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a56d6288-dfb5-404d-8a76-8dc3ce3e22af tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:57.494947 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a56d6288-dfb5-404d-8a76-8dc3ce3e22af tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:57.495705 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a56d6288-dfb5-404d-8a76-8dc3ce3e22af tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:57.599495 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-a56d6288-dfb5-404d-8a76-8dc3ce3e22af tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:57.623023 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-a56d6288-dfb5-404d-8a76-8dc3ce3e22af tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f" status: 200 len: 1614 microversion: 2.1 time: 0.154697 Oct 11 12:05:57.624157 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 268/548] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:57 2022] GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f => generated 1614 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:57.674899 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-b1d5e4ca-c5b0-4003-bfbc-46fd54cf0037 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:57.687277 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b1d5e4ca-c5b0-4003-bfbc-46fd54cf0037 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262" status: 200 len: 1319 microversion: 2.1 time: 0.295934 Oct 11 12:05:57.688726 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 281/549] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:57 2022] GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262 => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:58.668735 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-f9d3e226-ee54-4c3b-9d25-4ea9f0bf4305 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:58.679496 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-f9d3e226-ee54-4c3b-9d25-4ea9f0bf4305 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 4fb48466-ddf3-47f7-bade-b20976690c7f] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:58.703791 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f9d3e226-ee54-4c3b-9d25-4ea9f0bf4305 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:58.704976 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f9d3e226-ee54-4c3b-9d25-4ea9f0bf4305 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:58.705877 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f9d3e226-ee54-4c3b-9d25-4ea9f0bf4305 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:58.707566 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f9d3e226-ee54-4c3b-9d25-4ea9f0bf4305 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:58.708572 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f9d3e226-ee54-4c3b-9d25-4ea9f0bf4305 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:58.709523 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f9d3e226-ee54-4c3b-9d25-4ea9f0bf4305 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:58.727227 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-34b26dae-3152-47a2-8906-96393453e632 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:58.729105 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-34b26dae-3152-47a2-8906-96393453e632 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 5704b491-32a8-464f-8af0-ade817102262] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:58.749218 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-34b26dae-3152-47a2-8906-96393453e632 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:58.759753 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-34b26dae-3152-47a2-8906-96393453e632 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:58.760831 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-34b26dae-3152-47a2-8906-96393453e632 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:58.762527 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-34b26dae-3152-47a2-8906-96393453e632 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:58.763600 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-34b26dae-3152-47a2-8906-96393453e632 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:58.764505 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-34b26dae-3152-47a2-8906-96393453e632 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:58.888945 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-f9d3e226-ee54-4c3b-9d25-4ea9f0bf4305 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:58.905595 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-f9d3e226-ee54-4c3b-9d25-4ea9f0bf4305 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f" status: 200 len: 1614 microversion: 2.1 time: 0.243791 Oct 11 12:05:58.906001 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 269/550] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:58 2022] GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f => generated 1614 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:05:58.991868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-34b26dae-3152-47a2-8906-96393453e632 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:05:59.000223 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-34b26dae-3152-47a2-8906-96393453e632 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262" status: 200 len: 1319 microversion: 2.1 time: 0.279585 Oct 11 12:05:59.000898 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 282/551] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:58 2022] GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262 => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:05:59.932065 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-0e656afe-2df3-4f9e-a32d-1eed729b6962 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:05:59.932947 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-0e656afe-2df3-4f9e-a32d-1eed729b6962 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 4fb48466-ddf3-47f7-bade-b20976690c7f] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:05:59.941243 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0e656afe-2df3-4f9e-a32d-1eed729b6962 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:59.941733 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0e656afe-2df3-4f9e-a32d-1eed729b6962 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:59.942167 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0e656afe-2df3-4f9e-a32d-1eed729b6962 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:59.942925 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0e656afe-2df3-4f9e-a32d-1eed729b6962 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:59.943378 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0e656afe-2df3-4f9e-a32d-1eed729b6962 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:59.943777 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0e656afe-2df3-4f9e-a32d-1eed729b6962 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:59.989748 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0e656afe-2df3-4f9e-a32d-1eed729b6962 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:05:59.990628 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0e656afe-2df3-4f9e-a32d-1eed729b6962 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:05:59.991383 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0e656afe-2df3-4f9e-a32d-1eed729b6962 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:05:59.992159 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.objects.instance [None req-0e656afe-2df3-4f9e-a32d-1eed729b6962 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lazy-loading 'fault' on Instance uuid 4fb48466-ddf3-47f7-bade-b20976690c7f {{(pid=118994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:06:00.028024 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a54944a3-3f71-478d-871a-07ea658722d2 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:00.029359 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a54944a3-3f71-478d-871a-07ea658722d2 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 5704b491-32a8-464f-8af0-ade817102262] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:00.045078 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a54944a3-3f71-478d-871a-07ea658722d2 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:00.045942 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a54944a3-3f71-478d-871a-07ea658722d2 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:00.046751 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a54944a3-3f71-478d-871a-07ea658722d2 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:00.048237 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a54944a3-3f71-478d-871a-07ea658722d2 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:00.049100 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a54944a3-3f71-478d-871a-07ea658722d2 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:00.049866 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a54944a3-3f71-478d-871a-07ea658722d2 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:00.065553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-0e656afe-2df3-4f9e-a32d-1eed729b6962 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:06:00.071188 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell0:SELECT=2 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:00.086724 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-0e656afe-2df3-4f9e-a32d-1eed729b6962 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f" status: 200 len: 1330 microversion: 2.1 time: 0.159114 Oct 11 12:06:00.099821 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 270/552] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:05:59 2022] GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f => generated 1330 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:06:00.247864 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=2 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:00.328255 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a54944a3-3f71-478d-871a-07ea658722d2 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:06:00.338366 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a54944a3-3f71-478d-871a-07ea658722d2 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262" status: 200 len: 1319 microversion: 2.1 time: 0.317697 Oct 11 12:06:00.339258 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 283/553] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:06:00 2022] GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262 => generated 1319 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:06:01.128953 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-737087a3-f9c8-4d6c-afad-3355f52f9d08 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:01.129812 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-737087a3-f9c8-4d6c-afad-3355f52f9d08 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 4fb48466-ddf3-47f7-bade-b20976690c7f] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:01.131870 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell0:SELECT=6 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:01.139524 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-737087a3-f9c8-4d6c-afad-3355f52f9d08 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:01.140290 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-737087a3-f9c8-4d6c-afad-3355f52f9d08 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:01.140825 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-737087a3-f9c8-4d6c-afad-3355f52f9d08 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:01.141741 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-737087a3-f9c8-4d6c-afad-3355f52f9d08 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:01.142246 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-737087a3-f9c8-4d6c-afad-3355f52f9d08 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:01.142866 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-737087a3-f9c8-4d6c-afad-3355f52f9d08 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:01.159345 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.wsgi [None req-737087a3-f9c8-4d6c-afad-3355f52f9d08 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] HTTP exception thrown: Instance 4fb48466-ddf3-47f7-bade-b20976690c7f could not be found. Oct 11 12:06:01.162253 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-737087a3-f9c8-4d6c-afad-3355f52f9d08 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Request method failure captured: Oct 11 12:06:01.162253 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: request: GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f HTTP/1.1 Oct 11 12:06:01.162253 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept: application/json Oct 11 12:06:01.162253 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept-Encoding: identity Oct 11 12:06:01.162253 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Connection: close Oct 11 12:06:01.162253 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Length: 0 Oct 11 12:06:01.162253 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Type: application/json Oct 11 12:06:01.162253 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Host: 10.222.0.59 Oct 11 12:06:01.162253 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Openstack-System-Scope: None Oct 11 12:06:01.162253 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: User-Agent: python-urllib3/1.26.12 Oct 11 12:06:01.162253 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Auth-Token: gAAAAABjRVrDbBzKTyV9eZUXZryLVe-KpT4WYEHJaER5TFyRAvTSEg5lw7FxKmfGi17rpAnxooOQ2r63AULbLGHHY4hm760kGTTUbeHuyR9-shGVTsiYjly6leZlsPXT8VYCrZ-E0QA-DYApJOgvSEAYz3JHEXcb3Qg12yFjALYOMVuEZNDDhBk Oct 11 12:06:01.162253 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Id: None Oct 11 12:06:01.162253 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Name: None Oct 11 12:06:01.162253 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Identity-Status: Confirmed Oct 11 12:06:01.162253 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Is-Admin-Project: True Oct 11 12:06:01.162253 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Id: default Oct 11 12:06:01.162253 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Name: Default Oct 11 12:06:01.162253 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Id: c83f971a0ae04288a5c6dc87d3370979 Oct 11 12:06:01.162253 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Name: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:06:01.162253 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Role: reader,member Oct 11 12:06:01.162253 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Roles: reader,member Oct 11 12:06:01.164984 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:06:01.164984 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:06:01.164984 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Id: c83f971a0ae04288a5c6dc87d3370979 Oct 11 12:06:01.164984 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:06:01.164984 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User: tempest-AttachVolumeNegativeTest-1543839758-project Oct 11 12:06:01.164984 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Id: default Oct 11 12:06:01.164984 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Name: Default Oct 11 12:06:01.164984 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Id: 41d3680dda7c4cc8aeb6d086efca0775 Oct 11 12:06:01.164984 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Name: tempest-AttachVolumeNegativeTest-1543839758-project Oct 11 12:06:01.164984 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: method: > Oct 11 12:06:01.164984 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: exception: Instance 4fb48466-ddf3-47f7-bade-b20976690c7f could not be found. Oct 11 12:06:01.164984 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: action_args: {'id': '4fb48466-ddf3-47f7-bade-b20976690c7f'} Oct 11 12:06:01.166404 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:06:01.166404 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:06:01.166404 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:06:01.166404 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:06:01.166404 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:06:01.166404 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:06:01.166404 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:06:01.166404 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:06:01.166404 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:06:01.166404 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:06:01.166404 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fb48466-ddf3-47f7-bade-b20976690c7f could not be found. Oct 11 12:06:01.166404 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:06:01.166404 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:06:01.166404 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:06:01.166404 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:06:01.166404 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:06:01.166404 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:06:01.166404 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:06:01.166404 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:06:01.166404 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:06:01.169117 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:06:01.169117 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 12:06:01.169117 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 12:06:01.169117 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:06:01.169117 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:06:01.169117 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:06:01.169117 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:06:01.169117 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fb48466-ddf3-47f7-bade-b20976690c7f could not be found. Oct 11 12:06:01.169117 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:06:01.169117 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:06:01.169117 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:06:01.169117 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:06:01.169117 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:06:01.169117 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:06:01.169117 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:06:01.169117 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:06:01.169117 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fb48466-ddf3-47f7-bade-b20976690c7f could not be found. Oct 11 12:06:01.169117 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:06:01.173021 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-737087a3-f9c8-4d6c-afad-3355f52f9d08 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Returning 404 to user: Instance 4fb48466-ddf3-47f7-bade-b20976690c7f could not be found. {{(pid=118994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:06:01.173021 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-737087a3-f9c8-4d6c-afad-3355f52f9d08 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f" status: 404 len: 111 microversion: 2.1 time: 0.040651 Oct 11 12:06:01.173021 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 271/554] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:06:01 2022] GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:06:01.180305 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-72e783b4-199f-42a7-8555-9227d0daf648 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '.version_select at 0x7fd406752f70>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:01.213508 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-72e783b4-199f-42a7-8555-9227d0daf648 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-398869182" status: 202 len: 0 microversion: 2.1 time: 0.039045 Oct 11 12:06:01.217136 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 284/555] 10.222.0.59 () {58 vars in 1218 bytes} [Tue Oct 11 12:06:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-398869182 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 12:06:01.376063 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-1dbdd71a-5ed9-4c5c-b406-7dcdb639d0e0 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:01.376703 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-1dbdd71a-5ed9-4c5c-b406-7dcdb639d0e0 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 5704b491-32a8-464f-8af0-ade817102262] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:01.383934 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1dbdd71a-5ed9-4c5c-b406-7dcdb639d0e0 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:01.384860 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1dbdd71a-5ed9-4c5c-b406-7dcdb639d0e0 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:01.385255 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1dbdd71a-5ed9-4c5c-b406-7dcdb639d0e0 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:01.386062 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1dbdd71a-5ed9-4c5c-b406-7dcdb639d0e0 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:01.386607 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1dbdd71a-5ed9-4c5c-b406-7dcdb639d0e0 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:01.387153 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1dbdd71a-5ed9-4c5c-b406-7dcdb639d0e0 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:01.587101 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-1dbdd71a-5ed9-4c5c-b406-7dcdb639d0e0 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:06:01.601016 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-1dbdd71a-5ed9-4c5c-b406-7dcdb639d0e0 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262" status: 200 len: 1319 microversion: 2.1 time: 0.229115 Oct 11 12:06:01.603869 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 272/556] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:06:01 2022] GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:06:02.065248 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-aed8233c-295c-4536-b9b5-924ae95e21c0 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:02.065740 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-aed8233c-295c-4536-b9b5-924ae95e21c0 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:02.073007 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aed8233c-295c-4536-b9b5-924ae95e21c0 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:02.073493 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aed8233c-295c-4536-b9b5-924ae95e21c0 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:02.073927 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aed8233c-295c-4536-b9b5-924ae95e21c0 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:02.074683 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aed8233c-295c-4536-b9b5-924ae95e21c0 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:02.075139 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aed8233c-295c-4536-b9b5-924ae95e21c0 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:02.075556 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aed8233c-295c-4536-b9b5-924ae95e21c0 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:02.177276 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-aed8233c-295c-4536-b9b5-924ae95e21c0 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lazy-loading 'services' on Instance uuid ac5dba27-8c1b-4760-ad6f-7ab81244e186 {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:06:02.365506 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-aed8233c-295c-4536-b9b5-924ae95e21c0 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186/os-volume_attachments/47160c47-8ad8-4adc-8e54-750c06977f12" status: 202 len: 0 microversion: 2.1 time: 0.304921 Oct 11 12:06:02.366458 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 285/557] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Oct 11 12:06:02 2022] DELETE /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186/os-volume_attachments/47160c47-8ad8-4adc-8e54-750c06977f12 => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 12:06:02.376627 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-d246a6ee-5c51-4800-867b-45742a791881 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:02.379193 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-d246a6ee-5c51-4800-867b-45742a791881 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:02.388192 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d246a6ee-5c51-4800-867b-45742a791881 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:02.389085 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d246a6ee-5c51-4800-867b-45742a791881 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:02.390290 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d246a6ee-5c51-4800-867b-45742a791881 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:02.391616 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d246a6ee-5c51-4800-867b-45742a791881 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:02.392389 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d246a6ee-5c51-4800-867b-45742a791881 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:02.393066 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d246a6ee-5c51-4800-867b-45742a791881 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:02.436469 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-d246a6ee-5c51-4800-867b-45742a791881 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064768 Oct 11 12:06:02.437066 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 273/558] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Oct 11 12:06:02 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:06:02.628114 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7c80bbc3-10bc-4130-a6b3-ed7a8ac1faf6 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:02.628740 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7c80bbc3-10bc-4130-a6b3-ed7a8ac1faf6 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 5704b491-32a8-464f-8af0-ade817102262] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:02.637387 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c80bbc3-10bc-4130-a6b3-ed7a8ac1faf6 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:02.637894 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c80bbc3-10bc-4130-a6b3-ed7a8ac1faf6 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:02.638321 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c80bbc3-10bc-4130-a6b3-ed7a8ac1faf6 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:02.639122 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c80bbc3-10bc-4130-a6b3-ed7a8ac1faf6 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:02.639607 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c80bbc3-10bc-4130-a6b3-ed7a8ac1faf6 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:02.640047 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c80bbc3-10bc-4130-a6b3-ed7a8ac1faf6 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:02.833399 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7c80bbc3-10bc-4130-a6b3-ed7a8ac1faf6 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:06:02.842925 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7c80bbc3-10bc-4130-a6b3-ed7a8ac1faf6 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262" status: 200 len: 1319 microversion: 2.1 time: 0.219161 Oct 11 12:06:02.843726 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 286/559] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:06:02 2022] GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262 => generated 1319 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:06:03.015986 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-53529079-3cdc-42b0-8965-50e3e6d69664 req-cfaaf72e-33a0-499d-9bd9-6c409b859668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5704b491-32a8-464f-8af0-ade817102262", "name": "network-vif-plugged", "status": "completed", "tag": "813f82ae-ef0d-47c9-aebf-259b5e1e87b2"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:06:03.031992 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-53529079-3cdc-42b0-8965-50e3e6d69664 req-cfaaf72e-33a0-499d-9bd9-6c409b859668 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:03.032407 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-53529079-3cdc-42b0-8965-50e3e6d69664 req-cfaaf72e-33a0-499d-9bd9-6c409b859668 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:03.033046 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-53529079-3cdc-42b0-8965-50e3e6d69664 req-cfaaf72e-33a0-499d-9bd9-6c409b859668 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:03.045337 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-53529079-3cdc-42b0-8965-50e3e6d69664 req-cfaaf72e-33a0-499d-9bd9-6c409b859668 service nova] Creating event network-vif-plugged:813f82ae-ef0d-47c9-aebf-259b5e1e87b2 for instance 5704b491-32a8-464f-8af0-ade817102262 on hv-cinder-82099 Oct 11 12:06:03.051458 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-53529079-3cdc-42b0-8965-50e3e6d69664 req-cfaaf72e-33a0-499d-9bd9-6c409b859668 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151597 Oct 11 12:06:03.052464 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 274/560] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:06:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:06:03.452977 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-481b5c52-aaa2-489a-b18b-668d5cab23d3 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:03.456328 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-481b5c52-aaa2-489a-b18b-668d5cab23d3 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:03.463887 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-481b5c52-aaa2-489a-b18b-668d5cab23d3 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:03.464379 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-481b5c52-aaa2-489a-b18b-668d5cab23d3 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:03.464811 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-481b5c52-aaa2-489a-b18b-668d5cab23d3 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:03.465530 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-481b5c52-aaa2-489a-b18b-668d5cab23d3 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:03.465982 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-481b5c52-aaa2-489a-b18b-668d5cab23d3 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:03.466406 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-481b5c52-aaa2-489a-b18b-668d5cab23d3 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:03.500935 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-481b5c52-aaa2-489a-b18b-668d5cab23d3 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053678 Oct 11 12:06:03.501534 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 287/561] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Oct 11 12:06:03 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:06:03.868468 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-3374cfb1-2b1a-474f-ad5e-23d6343f44c9 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:03.869032 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-3374cfb1-2b1a-474f-ad5e-23d6343f44c9 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 5704b491-32a8-464f-8af0-ade817102262] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:03.876047 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3374cfb1-2b1a-474f-ad5e-23d6343f44c9 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:03.876559 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3374cfb1-2b1a-474f-ad5e-23d6343f44c9 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:03.877000 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3374cfb1-2b1a-474f-ad5e-23d6343f44c9 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:03.877732 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3374cfb1-2b1a-474f-ad5e-23d6343f44c9 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:03.878175 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3374cfb1-2b1a-474f-ad5e-23d6343f44c9 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:03.878640 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3374cfb1-2b1a-474f-ad5e-23d6343f44c9 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:04.033298 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-3374cfb1-2b1a-474f-ad5e-23d6343f44c9 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:06:04.044058 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-3374cfb1-2b1a-474f-ad5e-23d6343f44c9 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262" status: 200 len: 1319 microversion: 2.1 time: 0.180811 Oct 11 12:06:04.044698 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 275/562] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:06:03 2022] GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:06:04.513831 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-49c46770-7060-4e93-b720-08755821ac82 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:04.516141 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-49c46770-7060-4e93-b720-08755821ac82 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:04.523715 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-49c46770-7060-4e93-b720-08755821ac82 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:04.524199 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-49c46770-7060-4e93-b720-08755821ac82 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:04.524627 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-49c46770-7060-4e93-b720-08755821ac82 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:04.525646 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-49c46770-7060-4e93-b720-08755821ac82 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:04.526389 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-49c46770-7060-4e93-b720-08755821ac82 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:04.526906 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-49c46770-7060-4e93-b720-08755821ac82 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:04.563760 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-49c46770-7060-4e93-b720-08755821ac82 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054023 Oct 11 12:06:04.564311 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 288/563] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Oct 11 12:06:04 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 12:06:04.634065 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-e81c661e-05a7-4ce5-adde-24da8f0041d4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:04.634588 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-e81c661e-05a7-4ce5-adde-24da8f0041d4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:04.641457 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e81c661e-05a7-4ce5-adde-24da8f0041d4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:04.641947 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e81c661e-05a7-4ce5-adde-24da8f0041d4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:04.642381 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e81c661e-05a7-4ce5-adde-24da8f0041d4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:04.643126 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e81c661e-05a7-4ce5-adde-24da8f0041d4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:04.643608 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e81c661e-05a7-4ce5-adde-24da8f0041d4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:04.644146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e81c661e-05a7-4ce5-adde-24da8f0041d4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:04.672545 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-e81c661e-05a7-4ce5-adde-24da8f0041d4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Going to try to terminate instance {{(pid=118994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 12:06:04.688492 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:04.757064 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-e81c661e-05a7-4ce5-adde-24da8f0041d4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 204 len: 0 microversion: 2.1 time: 0.126607 Oct 11 12:06:04.757672 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 276/564] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Oct 11 12:06:04 2022] DELETE /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 12:06:04.768452 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-67fe3b9b-e7ca-4a81-b4f5-15a3349ee3c7 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:04.769221 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-67fe3b9b-e7ca-4a81-b4f5-15a3349ee3c7 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:04.776672 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-67fe3b9b-e7ca-4a81-b4f5-15a3349ee3c7 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:04.777159 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-67fe3b9b-e7ca-4a81-b4f5-15a3349ee3c7 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:04.777593 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-67fe3b9b-e7ca-4a81-b4f5-15a3349ee3c7 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:04.778292 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-67fe3b9b-e7ca-4a81-b4f5-15a3349ee3c7 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:04.778774 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-67fe3b9b-e7ca-4a81-b4f5-15a3349ee3c7 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:04.779202 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-67fe3b9b-e7ca-4a81-b4f5-15a3349ee3c7 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:04.933036 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-67fe3b9b-e7ca-4a81-b4f5-15a3349ee3c7 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:06:04.946312 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-67fe3b9b-e7ca-4a81-b4f5-15a3349ee3c7 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1682 microversion: 2.1 time: 0.182364 Oct 11 12:06:04.947353 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 289/565] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:06:04 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1682 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:06:05.071153 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-5986f515-ceba-42e8-aec5-657c961bc165 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:05.072340 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-5986f515-ceba-42e8-aec5-657c961bc165 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 5704b491-32a8-464f-8af0-ade817102262] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:05.083658 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5986f515-ceba-42e8-aec5-657c961bc165 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:05.084524 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5986f515-ceba-42e8-aec5-657c961bc165 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:05.085293 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5986f515-ceba-42e8-aec5-657c961bc165 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:05.086517 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5986f515-ceba-42e8-aec5-657c961bc165 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:05.087377 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5986f515-ceba-42e8-aec5-657c961bc165 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:05.088156 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5986f515-ceba-42e8-aec5-657c961bc165 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:05.244199 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-5986f515-ceba-42e8-aec5-657c961bc165 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:06:05.252505 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-5986f515-ceba-42e8-aec5-657c961bc165 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262" status: 200 len: 1319 microversion: 2.1 time: 0.188391 Oct 11 12:06:05.253083 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 277/566] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:06:05 2022] GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:06:05.971453 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-33100057-690f-4000-8b8b-72fa94d9b226 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:05.972257 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-33100057-690f-4000-8b8b-72fa94d9b226 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:05.979238 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-33100057-690f-4000-8b8b-72fa94d9b226 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:05.979722 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-33100057-690f-4000-8b8b-72fa94d9b226 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:05.980165 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-33100057-690f-4000-8b8b-72fa94d9b226 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:05.980861 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-33100057-690f-4000-8b8b-72fa94d9b226 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:05.981308 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-33100057-690f-4000-8b8b-72fa94d9b226 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:05.981716 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-33100057-690f-4000-8b8b-72fa94d9b226 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:06.154085 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-33100057-690f-4000-8b8b-72fa94d9b226 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:06:06.162786 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-33100057-690f-4000-8b8b-72fa94d9b226 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1682 microversion: 2.1 time: 0.195178 Oct 11 12:06:06.163385 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 290/567] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:06:05 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1682 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:06:06.296772 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-7d5bbce5-b799-42e8-8f8a-18e8b1520c8d tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:06.297950 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-7d5bbce5-b799-42e8-8f8a-18e8b1520c8d tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 5704b491-32a8-464f-8af0-ade817102262] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:06.309768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7d5bbce5-b799-42e8-8f8a-18e8b1520c8d tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:06.310500 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7d5bbce5-b799-42e8-8f8a-18e8b1520c8d tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:06.311261 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7d5bbce5-b799-42e8-8f8a-18e8b1520c8d tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:06.312529 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7d5bbce5-b799-42e8-8f8a-18e8b1520c8d tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:06.313337 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7d5bbce5-b799-42e8-8f8a-18e8b1520c8d tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:06.314093 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7d5bbce5-b799-42e8-8f8a-18e8b1520c8d tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:06.516649 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-7d5bbce5-b799-42e8-8f8a-18e8b1520c8d tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:06:06.526310 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-7d5bbce5-b799-42e8-8f8a-18e8b1520c8d tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262" status: 200 len: 1508 microversion: 2.1 time: 0.236649 Oct 11 12:06:06.527042 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 278/568] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:06:06 2022] GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262 => generated 1508 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:06:06.550447 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-390c6ee1-f4d2-41fc-b844-74e67deb050d tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0689f34d-eab3-464e-9951-3fd2f1837c0f", "device": "/dev/sdb"}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:06:06.553419 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-390c6ee1-f4d2-41fc-b844-74e67deb050d tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 5704b491-32a8-464f-8af0-ade817102262] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:06.559878 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-390c6ee1-f4d2-41fc-b844-74e67deb050d tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:06.560365 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-390c6ee1-f4d2-41fc-b844-74e67deb050d tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:06.560789 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-390c6ee1-f4d2-41fc-b844-74e67deb050d tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:06.561486 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-390c6ee1-f4d2-41fc-b844-74e67deb050d tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:06.561941 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-390c6ee1-f4d2-41fc-b844-74e67deb050d tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:06.562338 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-390c6ee1-f4d2-41fc-b844-74e67deb050d tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:06.993877 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:07.023775 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-390c6ee1-f4d2-41fc-b844-74e67deb050d tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "POST /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.477335 Oct 11 12:06:07.025142 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 291/569] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Oct 11 12:06:06 2022] POST /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262/os-volume_attachments => generated 194 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:06:07.187154 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-bf450c18-3f92-4a72-a828-0ac3a789f751 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:07.187890 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-bf450c18-3f92-4a72-a828-0ac3a789f751 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:07.195612 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bf450c18-3f92-4a72-a828-0ac3a789f751 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:07.196106 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bf450c18-3f92-4a72-a828-0ac3a789f751 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:07.196547 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bf450c18-3f92-4a72-a828-0ac3a789f751 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:07.197272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bf450c18-3f92-4a72-a828-0ac3a789f751 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:07.197722 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bf450c18-3f92-4a72-a828-0ac3a789f751 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:07.198145 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bf450c18-3f92-4a72-a828-0ac3a789f751 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:07.352448 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-bf450c18-3f92-4a72-a828-0ac3a789f751 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:06:07.361710 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-bf450c18-3f92-4a72-a828-0ac3a789f751 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1682 microversion: 2.1 time: 0.178524 Oct 11 12:06:07.362368 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 279/570] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:06:07 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1682 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:06:07.814532 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-b5a9b765-074f-4456-9f88-e7f067c29ba2 req-6d8d7309-c9d3-44f0-9fa7-64ffa8d8542c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ac5dba27-8c1b-4760-ad6f-7ab81244e186", "name": "network-vif-deleted", "tag": "4fee3639-3c5d-4ff4-9533-5ba1ecbb3bb5"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:06:07.828642 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-b5a9b765-074f-4456-9f88-e7f067c29ba2 req-6d8d7309-c9d3-44f0-9fa7-64ffa8d8542c service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:07.829582 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-b5a9b765-074f-4456-9f88-e7f067c29ba2 req-6d8d7309-c9d3-44f0-9fa7-64ffa8d8542c service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:07.830371 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-b5a9b765-074f-4456-9f88-e7f067c29ba2 req-6d8d7309-c9d3-44f0-9fa7-64ffa8d8542c service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:07.856536 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-b5a9b765-074f-4456-9f88-e7f067c29ba2 req-6d8d7309-c9d3-44f0-9fa7-64ffa8d8542c service nova] Creating event network-vif-deleted:4fee3639-3c5d-4ff4-9533-5ba1ecbb3bb5 for instance ac5dba27-8c1b-4760-ad6f-7ab81244e186 on hv-cinder-82099 Oct 11 12:06:07.879557 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-b5a9b765-074f-4456-9f88-e7f067c29ba2 req-6d8d7309-c9d3-44f0-9fa7-64ffa8d8542c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056794 Oct 11 12:06:07.881245 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 292/571] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:06:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:06:08.388656 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-d0f56394-4ad6-4656-86ce-049a9a3dc610 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:08.389530 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-d0f56394-4ad6-4656-86ce-049a9a3dc610 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:08.401246 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d0f56394-4ad6-4656-86ce-049a9a3dc610 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:08.402041 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d0f56394-4ad6-4656-86ce-049a9a3dc610 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:08.402700 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d0f56394-4ad6-4656-86ce-049a9a3dc610 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:08.403465 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d0f56394-4ad6-4656-86ce-049a9a3dc610 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:08.403973 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d0f56394-4ad6-4656-86ce-049a9a3dc610 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:08.404455 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d0f56394-4ad6-4656-86ce-049a9a3dc610 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:08.443504 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d0f56394-4ad6-4656-86ce-049a9a3dc610 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:08.443979 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d0f56394-4ad6-4656-86ce-049a9a3dc610 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:08.444403 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d0f56394-4ad6-4656-86ce-049a9a3dc610 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:08.444849 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.objects.instance [None req-d0f56394-4ad6-4656-86ce-049a9a3dc610 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lazy-loading 'fault' on Instance uuid ac5dba27-8c1b-4760-ad6f-7ab81244e186 {{(pid=118994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:06:08.492052 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-d0f56394-4ad6-4656-86ce-049a9a3dc610 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:06:08.503650 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-d0f56394-4ad6-4656-86ce-049a9a3dc610 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1332 microversion: 2.1 time: 0.118654 Oct 11 12:06:08.503650 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 280/572] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:06:08 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1332 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:06:09.526536 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-baec73c9-5dcf-42bc-be8c-f4e7897337ce tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:09.527314 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-baec73c9-5dcf-42bc-be8c-f4e7897337ce tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:09.534168 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-baec73c9-5dcf-42bc-be8c-f4e7897337ce tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:09.534756 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-baec73c9-5dcf-42bc-be8c-f4e7897337ce tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:09.535186 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-baec73c9-5dcf-42bc-be8c-f4e7897337ce tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:09.535883 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-baec73c9-5dcf-42bc-be8c-f4e7897337ce tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:09.536322 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-baec73c9-5dcf-42bc-be8c-f4e7897337ce tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:09.536774 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-baec73c9-5dcf-42bc-be8c-f4e7897337ce tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:09.569309 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-baec73c9-5dcf-42bc-be8c-f4e7897337ce tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:09.569787 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-baec73c9-5dcf-42bc-be8c-f4e7897337ce tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:09.570267 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-baec73c9-5dcf-42bc-be8c-f4e7897337ce tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:09.570677 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-baec73c9-5dcf-42bc-be8c-f4e7897337ce tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lazy-loading 'fault' on Instance uuid ac5dba27-8c1b-4760-ad6f-7ab81244e186 {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:06:09.615837 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-baec73c9-5dcf-42bc-be8c-f4e7897337ce tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:06:09.625111 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-baec73c9-5dcf-42bc-be8c-f4e7897337ce tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 200 len: 1332 microversion: 2.1 time: 0.103554 Oct 11 12:06:09.625721 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 293/573] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:06:09 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 1332 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:06:10.649331 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-7dcfe316-a86d-4c3f-a325-cf613e4e75d1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:10.649954 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-7dcfe316-a86d-4c3f-a325-cf613e4e75d1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:10.657041 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7dcfe316-a86d-4c3f-a325-cf613e4e75d1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:10.657527 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7dcfe316-a86d-4c3f-a325-cf613e4e75d1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:10.657919 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7dcfe316-a86d-4c3f-a325-cf613e4e75d1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:10.658670 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7dcfe316-a86d-4c3f-a325-cf613e4e75d1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:10.659120 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7dcfe316-a86d-4c3f-a325-cf613e4e75d1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:10.659652 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7dcfe316-a86d-4c3f-a325-cf613e4e75d1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:10.674150 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.wsgi [None req-7dcfe316-a86d-4c3f-a325-cf613e4e75d1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] HTTP exception thrown: Instance ac5dba27-8c1b-4760-ad6f-7ab81244e186 could not be found. Oct 11 12:06:10.675901 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-7dcfe316-a86d-4c3f-a325-cf613e4e75d1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Request method failure captured: Oct 11 12:06:10.675901 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: request: GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 HTTP/1.1 Oct 11 12:06:10.675901 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept: application/json Oct 11 12:06:10.675901 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept-Encoding: identity Oct 11 12:06:10.675901 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Connection: close Oct 11 12:06:10.675901 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Length: 0 Oct 11 12:06:10.675901 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Type: application/json Oct 11 12:06:10.675901 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Host: 10.222.0.59 Oct 11 12:06:10.675901 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Openstack-System-Scope: None Oct 11 12:06:10.675901 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: User-Agent: python-urllib3/1.26.12 Oct 11 12:06:10.675901 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Auth-Token: gAAAAABjRVrDbBzKTyV9eZUXZryLVe-KpT4WYEHJaER5TFyRAvTSEg5lw7FxKmfGi17rpAnxooOQ2r63AULbLGHHY4hm760kGTTUbeHuyR9-shGVTsiYjly6leZlsPXT8VYCrZ-E0QA-DYApJOgvSEAYz3JHEXcb3Qg12yFjALYOMVuEZNDDhBk Oct 11 12:06:10.675901 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Id: None Oct 11 12:06:10.675901 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Name: None Oct 11 12:06:10.675901 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Identity-Status: Confirmed Oct 11 12:06:10.675901 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Is-Admin-Project: True Oct 11 12:06:10.675901 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Id: default Oct 11 12:06:10.675901 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Name: Default Oct 11 12:06:10.675901 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Id: c83f971a0ae04288a5c6dc87d3370979 Oct 11 12:06:10.675901 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Name: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:06:10.675901 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Role: reader,member Oct 11 12:06:10.675901 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Roles: reader,member Oct 11 12:06:10.677667 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:06:10.677667 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:06:10.677667 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Id: c83f971a0ae04288a5c6dc87d3370979 Oct 11 12:06:10.677667 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:06:10.677667 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User: tempest-AttachVolumeNegativeTest-1543839758-project Oct 11 12:06:10.677667 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Id: default Oct 11 12:06:10.677667 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Name: Default Oct 11 12:06:10.677667 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Id: 41d3680dda7c4cc8aeb6d086efca0775 Oct 11 12:06:10.677667 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Name: tempest-AttachVolumeNegativeTest-1543839758-project Oct 11 12:06:10.677667 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: method: > Oct 11 12:06:10.677667 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: exception: Instance ac5dba27-8c1b-4760-ad6f-7ab81244e186 could not be found. Oct 11 12:06:10.677667 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: action_args: {'id': 'ac5dba27-8c1b-4760-ad6f-7ab81244e186'} Oct 11 12:06:10.678532 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:06:10.678532 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:06:10.678532 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:06:10.678532 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:06:10.678532 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:06:10.678532 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:06:10.678532 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:06:10.678532 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:06:10.678532 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:06:10.678532 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:06:10.678532 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac5dba27-8c1b-4760-ad6f-7ab81244e186 could not be found. Oct 11 12:06:10.678532 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:06:10.678532 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:06:10.678532 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:06:10.678532 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:06:10.678532 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:06:10.678532 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:06:10.678532 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:06:10.678532 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:06:10.678532 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:06:10.679929 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:06:10.679929 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 12:06:10.679929 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 12:06:10.679929 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:06:10.679929 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:06:10.679929 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:06:10.679929 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:06:10.679929 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac5dba27-8c1b-4760-ad6f-7ab81244e186 could not be found. Oct 11 12:06:10.679929 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:06:10.679929 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:06:10.679929 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:06:10.679929 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:06:10.679929 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:06:10.679929 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:06:10.679929 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:06:10.679929 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:06:10.679929 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac5dba27-8c1b-4760-ad6f-7ab81244e186 could not be found. Oct 11 12:06:10.679929 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:06:10.681189 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-7dcfe316-a86d-4c3f-a325-cf613e4e75d1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Returning 404 to user: Instance ac5dba27-8c1b-4760-ad6f-7ab81244e186 could not be found. {{(pid=118994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:06:10.681189 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-7dcfe316-a86d-4c3f-a325-cf613e4e75d1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 404 len: 111 microversion: 2.1 time: 0.032348 Oct 11 12:06:10.681189 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 281/574] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:06:10 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:06:10.686727 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f3358873-2ebf-46e6-b56a-4245f204fea3 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '.version_select at 0x7fd40675d820>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:10.708469 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f3358873-2ebf-46e6-b56a-4245f204fea3 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1946892434" status: 202 len: 0 microversion: 2.1 time: 0.025555 Oct 11 12:06:10.708965 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 294/575] 10.222.0.59 () {58 vars in 1221 bytes} [Tue Oct 11 12:06:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1946892434 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 12:06:11.632136 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-d8c73b04-4394-475b-a995-70da2488bd78 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Action: 'create', calling method: .version_select at 0x7fd4066ce670>, body: {"keypair": {"name": "tempest-keypair-753044975", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFeBCkOmFqq+aXLLSEmgfzwciU+SzE4Fk1PC6VNSKaw5eF9L8utSm2PzQZTeCtVS0JzxLyqfZ6GMnmswSn0ftxqll4g9y9hFmyeqFaw0r2B7HTbAmji26u71OgW6V3TbA=="}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:06:11.650139 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-d8c73b04-4394-475b-a995-70da2488bd78 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Getting quotas for project c83f971a0ae04288a5c6dc87d3370979. Resources: {'key_pairs'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 12:06:11.655743 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-d8c73b04-4394-475b-a995-70da2488bd78 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Getting quotas for user 41d3680dda7c4cc8aeb6d086efca0775 and project c83f971a0ae04288a5c6dc87d3370979. Resources: {'key_pairs'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 12:06:11.670210 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d8c73b04-4394-475b-a995-70da2488bd78 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [1d7b3ee6-f340-41f6-a709-bfb5bf92f925] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 12:06:12.678375 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO oslo.messaging._drivers.impl_rabbit [None req-d8c73b04-4394-475b-a995-70da2488bd78 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [1d7b3ee6-f340-41f6-a709-bfb5bf92f925] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 56732. Oct 11 12:06:12.695491 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-d8c73b04-4394-475b-a995-70da2488bd78 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.067387 Oct 11 12:06:12.696103 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 282/576] 10.222.0.59 () {60 vars in 1159 bytes} [Tue Oct 11 12:06:11 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1069 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:06:13.988552 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-4505e2b8-2e53-41e0-8e03-9112ec3d3bf4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1534115963", "imageRef": "09bcc8f8-a32f-4ec8-9ab2-a98964ad6a01", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "55e10b58-1f19-4291-9200-8a870118bbcb"}], "security_groups": [{"name": "tempest-securitygroup--884555688"}], "key_name": "tempest-keypair-753044975", "user_data": "}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:06:14.101725 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.network.neutron [None req-4505e2b8-2e53-41e0-8e03-9112ec3d3bf4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] validate_networks() for [('55e10b58-1f19-4291-9200-8a870118bbcb', None, None, None, None, None)] {{(pid=118995) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 12:06:14.552136 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-4505e2b8-2e53-41e0-8e03-9112ec3d3bf4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Flavor limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 12:06:14.552578 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-4505e2b8-2e53-41e0-8e03-9112ec3d3bf4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Image limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 12:06:14.553040 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-4505e2b8-2e53-41e0-8e03-9112ec3d3bf4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Flavor pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 12:06:14.553439 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-4505e2b8-2e53-41e0-8e03-9112ec3d3bf4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Image pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 12:06:14.553867 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-4505e2b8-2e53-41e0-8e03-9112ec3d3bf4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 12:06:14.565194 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4505e2b8-2e53-41e0-8e03-9112ec3d3bf4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:14.565676 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4505e2b8-2e53-41e0-8e03-9112ec3d3bf4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:14.566106 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4505e2b8-2e53-41e0-8e03-9112ec3d3bf4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:14.566864 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4505e2b8-2e53-41e0-8e03-9112ec3d3bf4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:14.567313 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4505e2b8-2e53-41e0-8e03-9112ec3d3bf4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:14.567752 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4505e2b8-2e53-41e0-8e03-9112ec3d3bf4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:14.586949 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-4505e2b8-2e53-41e0-8e03-9112ec3d3bf4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Getting quotas for project c83f971a0ae04288a5c6dc87d3370979. Resources: {'ram', 'instances', 'cores'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 12:06:14.591876 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-4505e2b8-2e53-41e0-8e03-9112ec3d3bf4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Getting quotas for user 41d3680dda7c4cc8aeb6d086efca0775 and project c83f971a0ae04288a5c6dc87d3370979. Resources: {'ram', 'instances', 'cores'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 12:06:14.606180 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-4505e2b8-2e53-41e0-8e03-9112ec3d3bf4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Going to run 1 instances... {{(pid=118995) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 12:06:14.608612 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-4505e2b8-2e53-41e0-8e03-9112ec3d3bf4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: c568e704-7d29-4312-957d-35ed16806e9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09bcc8f8-a32f-4ec8-9ab2-a98964ad6a01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118995) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 12:06:14.665582 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-4505e2b8-2e53-41e0-8e03-9112ec3d3bf4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.681761 Oct 11 12:06:14.666808 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 295/577] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Oct 11 12:06:13 2022] POST /compute/v2.1/servers => generated 401 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 12:06:14.679851 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-c5134e06-18d2-45ac-a217-4fd35732f969 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:14.680520 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-c5134e06-18d2-45ac-a217-4fd35732f969 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: c568e704-7d29-4312-957d-35ed16806e9e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:14.749761 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-c5134e06-18d2-45ac-a217-4fd35732f969 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:06:14.758223 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-c5134e06-18d2-45ac-a217-4fd35732f969 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e" status: 200 len: 1241 microversion: 2.1 time: 0.082824 Oct 11 12:06:14.758915 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 283/578] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:06:14 2022] GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:06:15.785411 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-631871d5-2fe7-4488-ad4f-5406d929fcaa tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:15.786444 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-631871d5-2fe7-4488-ad4f-5406d929fcaa tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: c568e704-7d29-4312-957d-35ed16806e9e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:15.797337 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-631871d5-2fe7-4488-ad4f-5406d929fcaa tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:15.797957 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-631871d5-2fe7-4488-ad4f-5406d929fcaa tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:15.798711 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-631871d5-2fe7-4488-ad4f-5406d929fcaa tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:15.799733 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-631871d5-2fe7-4488-ad4f-5406d929fcaa tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:15.800729 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-631871d5-2fe7-4488-ad4f-5406d929fcaa tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:15.801215 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-631871d5-2fe7-4488-ad4f-5406d929fcaa tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:15.886389 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-631871d5-2fe7-4488-ad4f-5406d929fcaa tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:06:15.894864 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-631871d5-2fe7-4488-ad4f-5406d929fcaa tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e" status: 200 len: 1293 microversion: 2.1 time: 0.116909 Oct 11 12:06:15.895807 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 296/579] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:06:15 2022] GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e => generated 1293 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:06:16.919941 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-a5df5444-f7c7-48dc-945b-58124232af59 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:16.921431 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-a5df5444-f7c7-48dc-945b-58124232af59 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: c568e704-7d29-4312-957d-35ed16806e9e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:16.929807 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a5df5444-f7c7-48dc-945b-58124232af59 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:16.930498 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a5df5444-f7c7-48dc-945b-58124232af59 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:16.931067 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a5df5444-f7c7-48dc-945b-58124232af59 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:16.932086 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a5df5444-f7c7-48dc-945b-58124232af59 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:16.932549 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a5df5444-f7c7-48dc-945b-58124232af59 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:16.932995 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a5df5444-f7c7-48dc-945b-58124232af59 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:17.097618 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-a5df5444-f7c7-48dc-945b-58124232af59 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:06:17.107490 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-a5df5444-f7c7-48dc-945b-58124232af59 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e" status: 200 len: 1366 microversion: 2.1 time: 0.191689 Oct 11 12:06:17.108093 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 284/580] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:06:16 2022] GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:06:18.132043 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-48aae056-1332-446c-9433-a07e045c86b5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:18.132708 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-48aae056-1332-446c-9433-a07e045c86b5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: c568e704-7d29-4312-957d-35ed16806e9e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:18.140136 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-48aae056-1332-446c-9433-a07e045c86b5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:18.140624 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-48aae056-1332-446c-9433-a07e045c86b5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:18.141057 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-48aae056-1332-446c-9433-a07e045c86b5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:18.141769 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-48aae056-1332-446c-9433-a07e045c86b5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:18.142216 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-48aae056-1332-446c-9433-a07e045c86b5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:18.142696 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-48aae056-1332-446c-9433-a07e045c86b5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:18.303480 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-48aae056-1332-446c-9433-a07e045c86b5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:06:18.312138 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-48aae056-1332-446c-9433-a07e045c86b5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e" status: 200 len: 1366 microversion: 2.1 time: 0.184395 Oct 11 12:06:18.312719 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 297/581] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:06:18 2022] GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:06:19.335814 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-1f28776a-89bc-4929-86de-df1c6e1f1f31 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:19.336584 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-1f28776a-89bc-4929-86de-df1c6e1f1f31 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: c568e704-7d29-4312-957d-35ed16806e9e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:19.343989 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1f28776a-89bc-4929-86de-df1c6e1f1f31 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:19.344532 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1f28776a-89bc-4929-86de-df1c6e1f1f31 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:19.345026 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1f28776a-89bc-4929-86de-df1c6e1f1f31 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:19.345733 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1f28776a-89bc-4929-86de-df1c6e1f1f31 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:19.346225 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1f28776a-89bc-4929-86de-df1c6e1f1f31 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:19.346793 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1f28776a-89bc-4929-86de-df1c6e1f1f31 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:19.500066 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-1f28776a-89bc-4929-86de-df1c6e1f1f31 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:06:19.509684 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-1f28776a-89bc-4929-86de-df1c6e1f1f31 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e" status: 200 len: 1366 microversion: 2.1 time: 0.177946 Oct 11 12:06:19.510431 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 285/582] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:06:19 2022] GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:06:20.535353 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-bdca892d-2630-4cdb-9dfd-9b70c5511163 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:20.536453 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-bdca892d-2630-4cdb-9dfd-9b70c5511163 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: c568e704-7d29-4312-957d-35ed16806e9e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:20.540389 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:20.544573 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bdca892d-2630-4cdb-9dfd-9b70c5511163 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:20.545052 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bdca892d-2630-4cdb-9dfd-9b70c5511163 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:20.545478 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bdca892d-2630-4cdb-9dfd-9b70c5511163 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:20.546183 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bdca892d-2630-4cdb-9dfd-9b70c5511163 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:20.546656 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bdca892d-2630-4cdb-9dfd-9b70c5511163 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:20.547075 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bdca892d-2630-4cdb-9dfd-9b70c5511163 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:20.603364 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-2bbbf5d8-937b-4c69-8a62-014f5942d606 req-39e42871-e0eb-4d04-af62-cb017532ceaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c568e704-7d29-4312-957d-35ed16806e9e", "tag": "5c5667a7-9915-4e21-9a3f-6ce9fdca27f9"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:06:20.609215 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:20.627636 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-2bbbf5d8-937b-4c69-8a62-014f5942d606 req-39e42871-e0eb-4d04-af62-cb017532ceaf service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:20.628551 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-2bbbf5d8-937b-4c69-8a62-014f5942d606 req-39e42871-e0eb-4d04-af62-cb017532ceaf service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:20.629389 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-2bbbf5d8-937b-4c69-8a62-014f5942d606 req-39e42871-e0eb-4d04-af62-cb017532ceaf service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:20.653140 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-2bbbf5d8-937b-4c69-8a62-014f5942d606 req-39e42871-e0eb-4d04-af62-cb017532ceaf service nova] Creating event network-changed:5c5667a7-9915-4e21-9a3f-6ce9fdca27f9 for instance c568e704-7d29-4312-957d-35ed16806e9e on hv-cinder-82099 Oct 11 12:06:20.661818 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-2bbbf5d8-937b-4c69-8a62-014f5942d606 req-39e42871-e0eb-4d04-af62-cb017532ceaf service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061796 Oct 11 12:06:20.664874 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 286/583] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:06:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 12:06:20.785451 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-bdca892d-2630-4cdb-9dfd-9b70c5511163 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:06:20.799420 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-bdca892d-2630-4cdb-9dfd-9b70c5511163 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e" status: 200 len: 1366 microversion: 2.1 time: 0.268382 Oct 11 12:06:20.800533 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 298/584] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:06:20 2022] GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:06:21.826530 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-b87b4d22-8516-4282-b270-362b425720ee tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:21.827452 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-b87b4d22-8516-4282-b270-362b425720ee tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: c568e704-7d29-4312-957d-35ed16806e9e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:21.835625 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b87b4d22-8516-4282-b270-362b425720ee tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:21.836187 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b87b4d22-8516-4282-b270-362b425720ee tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:21.836634 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b87b4d22-8516-4282-b270-362b425720ee tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:21.837409 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b87b4d22-8516-4282-b270-362b425720ee tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:21.837857 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b87b4d22-8516-4282-b270-362b425720ee tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:21.838362 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b87b4d22-8516-4282-b270-362b425720ee tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:22.019563 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-b87b4d22-8516-4282-b270-362b425720ee tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:06:22.037088 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-b87b4d22-8516-4282-b270-362b425720ee tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e" status: 200 len: 1366 microversion: 2.1 time: 0.216007 Oct 11 12:06:22.038537 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 287/585] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:06:21 2022] GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:06:23.070319 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d7517973-ff03-49aa-a9bd-8b4edeef8681 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:23.071007 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d7517973-ff03-49aa-a9bd-8b4edeef8681 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: c568e704-7d29-4312-957d-35ed16806e9e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:23.078113 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7517973-ff03-49aa-a9bd-8b4edeef8681 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:23.078633 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7517973-ff03-49aa-a9bd-8b4edeef8681 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:23.079090 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7517973-ff03-49aa-a9bd-8b4edeef8681 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:23.079800 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7517973-ff03-49aa-a9bd-8b4edeef8681 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:23.080243 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7517973-ff03-49aa-a9bd-8b4edeef8681 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:23.080665 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d7517973-ff03-49aa-a9bd-8b4edeef8681 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:23.230236 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d7517973-ff03-49aa-a9bd-8b4edeef8681 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:06:23.247027 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d7517973-ff03-49aa-a9bd-8b4edeef8681 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e" status: 200 len: 1366 microversion: 2.1 time: 0.180454 Oct 11 12:06:23.247765 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 299/586] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:06:23 2022] GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:06:24.271062 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-f5c4949b-91a5-4c50-abd1-beb6cb851002 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:24.271636 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-f5c4949b-91a5-4c50-abd1-beb6cb851002 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: c568e704-7d29-4312-957d-35ed16806e9e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:24.278498 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f5c4949b-91a5-4c50-abd1-beb6cb851002 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:24.279014 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f5c4949b-91a5-4c50-abd1-beb6cb851002 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:24.279436 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f5c4949b-91a5-4c50-abd1-beb6cb851002 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:24.280196 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f5c4949b-91a5-4c50-abd1-beb6cb851002 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:24.280629 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f5c4949b-91a5-4c50-abd1-beb6cb851002 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:24.281040 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f5c4949b-91a5-4c50-abd1-beb6cb851002 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:24.432003 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-f5c4949b-91a5-4c50-abd1-beb6cb851002 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:06:24.440177 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-f5c4949b-91a5-4c50-abd1-beb6cb851002 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e" status: 200 len: 1366 microversion: 2.1 time: 0.173543 Oct 11 12:06:24.440770 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 288/587] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:06:24 2022] GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:06:24.441497 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-faafccdd-ce4f-4460-80f0-0edf24e90ffb tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:24.442053 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-faafccdd-ce4f-4460-80f0-0edf24e90ffb tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 5704b491-32a8-464f-8af0-ade817102262] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:24.449760 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-faafccdd-ce4f-4460-80f0-0edf24e90ffb tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:24.450228 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-faafccdd-ce4f-4460-80f0-0edf24e90ffb tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:24.450711 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-faafccdd-ce4f-4460-80f0-0edf24e90ffb tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:24.451414 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-faafccdd-ce4f-4460-80f0-0edf24e90ffb tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:24.451862 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-faafccdd-ce4f-4460-80f0-0edf24e90ffb tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:24.452283 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-faafccdd-ce4f-4460-80f0-0edf24e90ffb tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:24.549863 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-faafccdd-ce4f-4460-80f0-0edf24e90ffb tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lazy-loading 'services' on Instance uuid 5704b491-32a8-464f-8af0-ade817102262 {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:06:24.576080 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=2 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:24.600869 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=6 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:24.637628 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-faafccdd-ce4f-4460-80f0-0edf24e90ffb tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262/os-volume_attachments/0689f34d-eab3-464e-9951-3fd2f1837c0f" status: 202 len: 0 microversion: 2.1 time: 0.199730 Oct 11 12:06:24.638256 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 300/588] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Oct 11 12:06:24 2022] DELETE /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262/os-volume_attachments/0689f34d-eab3-464e-9951-3fd2f1837c0f => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 12:06:25.478979 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-6d9c3474-852e-4363-83eb-2b915d63644b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:25.479607 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-6d9c3474-852e-4363-83eb-2b915d63644b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: c568e704-7d29-4312-957d-35ed16806e9e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:25.481731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell0:SELECT=6 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:06:25.489784 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6d9c3474-852e-4363-83eb-2b915d63644b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:25.490263 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6d9c3474-852e-4363-83eb-2b915d63644b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:25.490778 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6d9c3474-852e-4363-83eb-2b915d63644b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:25.491557 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6d9c3474-852e-4363-83eb-2b915d63644b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:25.491991 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6d9c3474-852e-4363-83eb-2b915d63644b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:25.492404 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6d9c3474-852e-4363-83eb-2b915d63644b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:25.637159 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-6d9c3474-852e-4363-83eb-2b915d63644b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:06:25.645734 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-6d9c3474-852e-4363-83eb-2b915d63644b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e" status: 200 len: 1366 microversion: 2.1 time: 0.171600 Oct 11 12:06:25.646326 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 289/589] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:06:25 2022] GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:06:25.779051 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-bd2b5cfb-f1d8-405e-a4f9-cde3243acc12 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:25.779754 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-bd2b5cfb-f1d8-405e-a4f9-cde3243acc12 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 5704b491-32a8-464f-8af0-ade817102262] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:25.787046 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd2b5cfb-f1d8-405e-a4f9-cde3243acc12 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:25.787740 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd2b5cfb-f1d8-405e-a4f9-cde3243acc12 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:25.788224 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd2b5cfb-f1d8-405e-a4f9-cde3243acc12 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:25.788962 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd2b5cfb-f1d8-405e-a4f9-cde3243acc12 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:25.789437 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd2b5cfb-f1d8-405e-a4f9-cde3243acc12 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:25.789860 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-bd2b5cfb-f1d8-405e-a4f9-cde3243acc12 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:25.821391 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-bd2b5cfb-f1d8-405e-a4f9-cde3243acc12 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 5704b491-32a8-464f-8af0-ade817102262] Going to try to terminate instance {{(pid=118995) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 12:06:25.910173 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-bd2b5cfb-f1d8-405e-a4f9-cde3243acc12 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262" status: 204 len: 0 microversion: 2.1 time: 0.135571 Oct 11 12:06:25.911441 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 301/590] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Oct 11 12:06:25 2022] DELETE /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 12:06:25.920814 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-6fd95f39-2155-491e-a98a-488ea7d16a1a tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:25.921557 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-6fd95f39-2155-491e-a98a-488ea7d16a1a tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 5704b491-32a8-464f-8af0-ade817102262] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:25.930290 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6fd95f39-2155-491e-a98a-488ea7d16a1a tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:25.931054 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6fd95f39-2155-491e-a98a-488ea7d16a1a tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:25.931489 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6fd95f39-2155-491e-a98a-488ea7d16a1a tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:25.932223 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6fd95f39-2155-491e-a98a-488ea7d16a1a tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:25.932677 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6fd95f39-2155-491e-a98a-488ea7d16a1a tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:25.933353 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6fd95f39-2155-491e-a98a-488ea7d16a1a tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:26.098443 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-6fd95f39-2155-491e-a98a-488ea7d16a1a tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:06:26.109559 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-6fd95f39-2155-491e-a98a-488ea7d16a1a tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262" status: 200 len: 1514 microversion: 2.1 time: 0.192784 Oct 11 12:06:26.110400 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 290/591] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:06:25 2022] GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262 => generated 1514 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:06:26.669833 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-04b7caf7-9fb3-4d03-ae85-26f4c3825189 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:26.670545 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-04b7caf7-9fb3-4d03-ae85-26f4c3825189 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: c568e704-7d29-4312-957d-35ed16806e9e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:26.676702 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04b7caf7-9fb3-4d03-ae85-26f4c3825189 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:26.677207 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04b7caf7-9fb3-4d03-ae85-26f4c3825189 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:26.677633 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04b7caf7-9fb3-4d03-ae85-26f4c3825189 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:26.678362 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04b7caf7-9fb3-4d03-ae85-26f4c3825189 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:26.678884 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04b7caf7-9fb3-4d03-ae85-26f4c3825189 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:26.679299 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04b7caf7-9fb3-4d03-ae85-26f4c3825189 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:26.703808 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-d3d77ea7-7607-43b7-8d20-7894fe0fa3b5 req-e500528a-625f-4992-a1a9-437e85c558ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c568e704-7d29-4312-957d-35ed16806e9e", "name": "network-vif-plugged", "status": "completed", "tag": "5c5667a7-9915-4e21-9a3f-6ce9fdca27f9"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:06:26.716999 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-d3d77ea7-7607-43b7-8d20-7894fe0fa3b5 req-e500528a-625f-4992-a1a9-437e85c558ae service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:26.717459 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-d3d77ea7-7607-43b7-8d20-7894fe0fa3b5 req-e500528a-625f-4992-a1a9-437e85c558ae service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:26.717889 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-d3d77ea7-7607-43b7-8d20-7894fe0fa3b5 req-e500528a-625f-4992-a1a9-437e85c558ae service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:26.732395 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-d3d77ea7-7607-43b7-8d20-7894fe0fa3b5 req-e500528a-625f-4992-a1a9-437e85c558ae service nova] Creating event network-vif-plugged:5c5667a7-9915-4e21-9a3f-6ce9fdca27f9 for instance c568e704-7d29-4312-957d-35ed16806e9e on hv-cinder-82099 Oct 11 12:06:26.737475 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-d3d77ea7-7607-43b7-8d20-7894fe0fa3b5 req-e500528a-625f-4992-a1a9-437e85c558ae service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038660 Oct 11 12:06:26.738062 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 291/592] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:06:26.827545 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-04b7caf7-9fb3-4d03-ae85-26f4c3825189 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:06:26.835714 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-04b7caf7-9fb3-4d03-ae85-26f4c3825189 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e" status: 200 len: 1366 microversion: 2.1 time: 0.170171 Oct 11 12:06:26.836306 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 302/593] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:06:26 2022] GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:06:27.134488 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-de27acd0-3890-45c7-ad0d-fdc49afa199b tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:27.135247 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-de27acd0-3890-45c7-ad0d-fdc49afa199b tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 5704b491-32a8-464f-8af0-ade817102262] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:27.142789 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-de27acd0-3890-45c7-ad0d-fdc49afa199b tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:27.143423 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-de27acd0-3890-45c7-ad0d-fdc49afa199b tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:27.143917 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-de27acd0-3890-45c7-ad0d-fdc49afa199b tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:27.144746 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-de27acd0-3890-45c7-ad0d-fdc49afa199b tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:27.145675 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-de27acd0-3890-45c7-ad0d-fdc49afa199b tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:27.147187 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-de27acd0-3890-45c7-ad0d-fdc49afa199b tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:27.295263 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-de27acd0-3890-45c7-ad0d-fdc49afa199b tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:06:27.304873 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-de27acd0-3890-45c7-ad0d-fdc49afa199b tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262" status: 200 len: 1514 microversion: 2.1 time: 0.174641 Oct 11 12:06:27.305710 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 292/594] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:06:27 2022] GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262 => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:06:27.859571 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ac6a1d0b-7348-4193-a6c2-2a6d41b66e8e tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:27.860439 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ac6a1d0b-7348-4193-a6c2-2a6d41b66e8e tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: c568e704-7d29-4312-957d-35ed16806e9e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:27.867829 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ac6a1d0b-7348-4193-a6c2-2a6d41b66e8e tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:27.868306 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ac6a1d0b-7348-4193-a6c2-2a6d41b66e8e tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:27.868725 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ac6a1d0b-7348-4193-a6c2-2a6d41b66e8e tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:27.869404 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ac6a1d0b-7348-4193-a6c2-2a6d41b66e8e tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:27.869848 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ac6a1d0b-7348-4193-a6c2-2a6d41b66e8e tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:27.870260 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ac6a1d0b-7348-4193-a6c2-2a6d41b66e8e tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:28.017702 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ac6a1d0b-7348-4193-a6c2-2a6d41b66e8e tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:06:28.026365 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ac6a1d0b-7348-4193-a6c2-2a6d41b66e8e tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e" status: 200 len: 1366 microversion: 2.1 time: 0.170949 Oct 11 12:06:28.030744 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 303/595] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:06:27 2022] GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:06:28.335021 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-f7bbfb55-70c1-4f90-93ea-48149ea0f0db tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:28.335730 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-f7bbfb55-70c1-4f90-93ea-48149ea0f0db tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 5704b491-32a8-464f-8af0-ade817102262] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:28.342710 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f7bbfb55-70c1-4f90-93ea-48149ea0f0db tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:28.343191 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f7bbfb55-70c1-4f90-93ea-48149ea0f0db tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:28.343644 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f7bbfb55-70c1-4f90-93ea-48149ea0f0db tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:28.344317 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f7bbfb55-70c1-4f90-93ea-48149ea0f0db tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:28.344761 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f7bbfb55-70c1-4f90-93ea-48149ea0f0db tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:28.345178 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f7bbfb55-70c1-4f90-93ea-48149ea0f0db tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:28.496181 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-f7bbfb55-70c1-4f90-93ea-48149ea0f0db tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:06:28.507790 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-f7bbfb55-70c1-4f90-93ea-48149ea0f0db tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262" status: 200 len: 1514 microversion: 2.1 time: 0.176416 Oct 11 12:06:28.508386 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 293/596] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:06:28 2022] GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262 => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:06:29.050285 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3d2ae111-ff10-476c-baad-1200f4f706b8 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:29.051217 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-3d2ae111-ff10-476c-baad-1200f4f706b8 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: c568e704-7d29-4312-957d-35ed16806e9e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:29.059967 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3d2ae111-ff10-476c-baad-1200f4f706b8 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:29.060541 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3d2ae111-ff10-476c-baad-1200f4f706b8 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:29.060985 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3d2ae111-ff10-476c-baad-1200f4f706b8 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:29.062263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3d2ae111-ff10-476c-baad-1200f4f706b8 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:29.063170 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3d2ae111-ff10-476c-baad-1200f4f706b8 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:29.063941 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3d2ae111-ff10-476c-baad-1200f4f706b8 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:29.280539 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-3d2ae111-ff10-476c-baad-1200f4f706b8 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:06:29.288797 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-3d2ae111-ff10-476c-baad-1200f4f706b8 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e" status: 200 len: 1366 microversion: 2.1 time: 0.242803 Oct 11 12:06:29.289664 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 304/597] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:06:29 2022] GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:06:29.495103 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-92447981-3964-4347-b0bc-503c4843312a req-6a100b65-b7c0-4a74-a5d2-a9e6a3f5b815 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5704b491-32a8-464f-8af0-ade817102262", "name": "network-vif-deleted", "tag": "813f82ae-ef0d-47c9-aebf-259b5e1e87b2"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:06:29.504944 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-92447981-3964-4347-b0bc-503c4843312a req-6a100b65-b7c0-4a74-a5d2-a9e6a3f5b815 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:29.505418 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-92447981-3964-4347-b0bc-503c4843312a req-6a100b65-b7c0-4a74-a5d2-a9e6a3f5b815 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:29.505839 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-92447981-3964-4347-b0bc-503c4843312a req-6a100b65-b7c0-4a74-a5d2-a9e6a3f5b815 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:29.523540 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-92447981-3964-4347-b0bc-503c4843312a req-6a100b65-b7c0-4a74-a5d2-a9e6a3f5b815 service nova] Creating event network-vif-deleted:813f82ae-ef0d-47c9-aebf-259b5e1e87b2 for instance 5704b491-32a8-464f-8af0-ade817102262 on hv-cinder-82099 Oct 11 12:06:29.528760 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-92447981-3964-4347-b0bc-503c4843312a req-6a100b65-b7c0-4a74-a5d2-a9e6a3f5b815 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037283 Oct 11 12:06:29.529501 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 294/598] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:06:29.532420 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-efce8ef9-6d4d-41ba-a409-3566b5ee040b tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:29.532877 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-efce8ef9-6d4d-41ba-a409-3566b5ee040b tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 5704b491-32a8-464f-8af0-ade817102262] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:29.539584 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-efce8ef9-6d4d-41ba-a409-3566b5ee040b tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:29.540102 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-efce8ef9-6d4d-41ba-a409-3566b5ee040b tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:29.540540 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-efce8ef9-6d4d-41ba-a409-3566b5ee040b tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:29.541242 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-efce8ef9-6d4d-41ba-a409-3566b5ee040b tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:29.541689 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-efce8ef9-6d4d-41ba-a409-3566b5ee040b tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:29.542164 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-efce8ef9-6d4d-41ba-a409-3566b5ee040b tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:29.608087 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-efce8ef9-6d4d-41ba-a409-3566b5ee040b tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4e098a260b94b2089801f02bdb0b126', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8908fef147b141b088ec5d458112e624', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:06:29.616567 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-efce8ef9-6d4d-41ba-a409-3566b5ee040b tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262" status: 200 len: 1472 microversion: 2.1 time: 0.088283 Oct 11 12:06:29.617121 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 305/599] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:06:29 2022] GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262 => generated 1472 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:06:30.312656 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-d13d41de-79bc-4e2c-8357-7a2f4ed189b5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:30.313339 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-d13d41de-79bc-4e2c-8357-7a2f4ed189b5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: c568e704-7d29-4312-957d-35ed16806e9e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:30.320424 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d13d41de-79bc-4e2c-8357-7a2f4ed189b5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:30.320898 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d13d41de-79bc-4e2c-8357-7a2f4ed189b5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:30.321326 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d13d41de-79bc-4e2c-8357-7a2f4ed189b5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:30.322015 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d13d41de-79bc-4e2c-8357-7a2f4ed189b5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:30.322450 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d13d41de-79bc-4e2c-8357-7a2f4ed189b5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:30.322892 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d13d41de-79bc-4e2c-8357-7a2f4ed189b5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:30.469071 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-d13d41de-79bc-4e2c-8357-7a2f4ed189b5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:06:30.477800 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-d13d41de-79bc-4e2c-8357-7a2f4ed189b5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e" status: 200 len: 1556 microversion: 2.1 time: 0.169420 Oct 11 12:06:30.478711 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 295/600] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:06:30 2022] GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e => generated 1556 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:06:30.503009 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e233c91d-6f0d-4afb-bcd0-99767be7da23 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:30.503564 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e233c91d-6f0d-4afb-bcd0-99767be7da23 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: c568e704-7d29-4312-957d-35ed16806e9e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:30.510435 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e233c91d-6f0d-4afb-bcd0-99767be7da23 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:30.511030 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e233c91d-6f0d-4afb-bcd0-99767be7da23 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:30.511392 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e233c91d-6f0d-4afb-bcd0-99767be7da23 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:30.512097 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e233c91d-6f0d-4afb-bcd0-99767be7da23 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:30.512544 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e233c91d-6f0d-4afb-bcd0-99767be7da23 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:30.512965 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e233c91d-6f0d-4afb-bcd0-99767be7da23 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:30.602286 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e233c91d-6f0d-4afb-bcd0-99767be7da23 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.103869 Oct 11 12:06:30.602933 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 306/601] 10.222.0.59 () {58 vars in 1275 bytes} [Tue Oct 11 12:06:30 2022] GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:06:30.640230 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-9f51e3b6-18e5-4e0b-9acc-627e3fcea532 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:06:30.640942 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-9f51e3b6-18e5-4e0b-9acc-627e3fcea532 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] [instance: 5704b491-32a8-464f-8af0-ade817102262] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:06:30.648280 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9f51e3b6-18e5-4e0b-9acc-627e3fcea532 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:30.648761 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9f51e3b6-18e5-4e0b-9acc-627e3fcea532 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:30.649192 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9f51e3b6-18e5-4e0b-9acc-627e3fcea532 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:30.649924 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9f51e3b6-18e5-4e0b-9acc-627e3fcea532 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:30.650404 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9f51e3b6-18e5-4e0b-9acc-627e3fcea532 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:30.650792 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9f51e3b6-18e5-4e0b-9acc-627e3fcea532 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:30.665310 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.wsgi [None req-9f51e3b6-18e5-4e0b-9acc-627e3fcea532 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] HTTP exception thrown: Instance 5704b491-32a8-464f-8af0-ade817102262 could not be found. Oct 11 12:06:30.667040 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-9f51e3b6-18e5-4e0b-9acc-627e3fcea532 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Request method failure captured: Oct 11 12:06:30.667040 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: request: GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262 HTTP/1.1 Oct 11 12:06:30.667040 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept: application/json Oct 11 12:06:30.667040 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept-Encoding: identity Oct 11 12:06:30.667040 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Connection: close Oct 11 12:06:30.667040 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Length: 0 Oct 11 12:06:30.667040 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Type: application/json Oct 11 12:06:30.667040 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Host: 10.222.0.59 Oct 11 12:06:30.667040 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Openstack-System-Scope: None Oct 11 12:06:30.667040 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: User-Agent: python-urllib3/1.26.12 Oct 11 12:06:30.667040 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Auth-Token: gAAAAABjRVvEdzTO9RqoFFtPibLTQtcVJuJ41DpE_-zCst6bSGcdD8kbO1B7xVW2cJ-zXn7Bdd24eFv4Gm8-4tWxH0yPhAMpX7c6vIIt_bvUUfABRZ7H0xGXawppWtsxmFuKR-7y3vXqe9XAFY0C_kUaI1fBNIURobKJYYFBpib0WrRm7_mAPtI Oct 11 12:06:30.667040 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Id: None Oct 11 12:06:30.667040 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Name: None Oct 11 12:06:30.667040 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Identity-Status: Confirmed Oct 11 12:06:30.667040 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Is-Admin-Project: True Oct 11 12:06:30.667040 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Id: default Oct 11 12:06:30.667040 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Name: Default Oct 11 12:06:30.667040 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Id: 8908fef147b141b088ec5d458112e624 Oct 11 12:06:30.667040 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1962236174 Oct 11 12:06:30.667040 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Role: reader,member Oct 11 12:06:30.667040 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Roles: reader,member Oct 11 12:06:30.669054 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8908fef147b141b088ec5d458112e624"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8908fef147b141b088ec5d458112e624"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8908fef147b141b088ec5d458112e624"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8908fef147b141b088ec5d458112e624"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:06:30.669054 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant: tempest-VolumesSnapshotTestJSON-1962236174 Oct 11 12:06:30.669054 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Id: 8908fef147b141b088ec5d458112e624 Oct 11 12:06:30.669054 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1962236174 Oct 11 12:06:30.669054 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User: tempest-VolumesSnapshotTestJSON-1962236174-project Oct 11 12:06:30.669054 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Id: default Oct 11 12:06:30.669054 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Name: Default Oct 11 12:06:30.669054 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Id: e4e098a260b94b2089801f02bdb0b126 Oct 11 12:06:30.669054 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Name: tempest-VolumesSnapshotTestJSON-1962236174-project Oct 11 12:06:30.669054 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: method: > Oct 11 12:06:30.669054 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: exception: Instance 5704b491-32a8-464f-8af0-ade817102262 could not be found. Oct 11 12:06:30.669054 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: action_args: {'id': '5704b491-32a8-464f-8af0-ade817102262'} Oct 11 12:06:30.670272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:06:30.670272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:06:30.670272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:06:30.670272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:06:30.670272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:06:30.670272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:06:30.670272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:06:30.670272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:06:30.670272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:06:30.670272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:06:30.670272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5704b491-32a8-464f-8af0-ade817102262 could not be found. Oct 11 12:06:30.670272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:06:30.670272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:06:30.670272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:06:30.670272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:06:30.670272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:06:30.670272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:06:30.670272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:06:30.670272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:06:30.670272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:06:30.671553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:06:30.671553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 12:06:30.671553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 12:06:30.671553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:06:30.671553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:06:30.671553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:06:30.671553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:06:30.671553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5704b491-32a8-464f-8af0-ade817102262 could not be found. Oct 11 12:06:30.671553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:06:30.671553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:06:30.671553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:06:30.671553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:06:30.671553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:06:30.671553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:06:30.671553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:06:30.671553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:06:30.671553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5704b491-32a8-464f-8af0-ade817102262 could not be found. Oct 11 12:06:30.671553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:06:30.674984 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-9f51e3b6-18e5-4e0b-9acc-627e3fcea532 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] Returning 404 to user: Instance 5704b491-32a8-464f-8af0-ade817102262 could not be found. {{(pid=118994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:06:30.674984 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-9f51e3b6-18e5-4e0b-9acc-627e3fcea532 tempest-VolumesSnapshotTestJSON-1962236174 tempest-VolumesSnapshotTestJSON-1962236174-project] 10.222.0.59 "GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262" status: 404 len: 111 microversion: 2.1 time: 0.032371 Oct 11 12:06:30.674984 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 296/602] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:06:30 2022] GET /compute/v2.1/servers/5704b491-32a8-464f-8af0-ade817102262 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:06:32.039540 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-957ac93a-f0fc-4a44-8903-db4749884210 req-09b2a18d-6c7c-468c-906c-5e808c864e5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c568e704-7d29-4312-957d-35ed16806e9e", "tag": "5c5667a7-9915-4e21-9a3f-6ce9fdca27f9"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:06:32.049901 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-957ac93a-f0fc-4a44-8903-db4749884210 req-09b2a18d-6c7c-468c-906c-5e808c864e5f service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:06:32.050460 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-957ac93a-f0fc-4a44-8903-db4749884210 req-09b2a18d-6c7c-468c-906c-5e808c864e5f service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:06:32.051098 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-957ac93a-f0fc-4a44-8903-db4749884210 req-09b2a18d-6c7c-468c-906c-5e808c864e5f service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:06:32.064639 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-957ac93a-f0fc-4a44-8903-db4749884210 req-09b2a18d-6c7c-468c-906c-5e808c864e5f service nova] Creating event network-changed:5c5667a7-9915-4e21-9a3f-6ce9fdca27f9 for instance c568e704-7d29-4312-957d-35ed16806e9e on hv-cinder-82099 Oct 11 12:06:32.071774 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-957ac93a-f0fc-4a44-8903-db4749884210 req-09b2a18d-6c7c-468c-906c-5e808c864e5f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036218 Oct 11 12:06:32.072439 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 307/603] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:06:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:07:01.778344 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-8a34cf80-16de-4358-bafb-4c06f264e4ed tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:01.779616 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-8a34cf80-16de-4358-bafb-4c06f264e4ed tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:01.800067 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_api:SELECT=21 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:01.804129 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:01.808574 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8a34cf80-16de-4358-bafb-4c06f264e4ed tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:01.809719 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8a34cf80-16de-4358-bafb-4c06f264e4ed tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:01.810166 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8a34cf80-16de-4358-bafb-4c06f264e4ed tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:01.813083 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8a34cf80-16de-4358-bafb-4c06f264e4ed tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:01.813792 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8a34cf80-16de-4358-bafb-4c06f264e4ed tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:01.820009 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8a34cf80-16de-4358-bafb-4c06f264e4ed tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:01.991370 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.objects.instance [None req-8a34cf80-16de-4358-bafb-4c06f264e4ed tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lazy-loading 'services' on Instance uuid e3277e26-d502-49fd-ba21-b427effd9d91 {{(pid=118994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:07:02.157104 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-8a34cf80-16de-4358-bafb-4c06f264e4ed tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "DELETE /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91/os-volume_attachments/959fac13-c58a-4173-adbc-bc8a4a6367de" status: 202 len: 0 microversion: 2.1 time: 0.375786 Oct 11 12:07:02.157878 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 297/604] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Oct 11 12:07:01 2022] DELETE /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91/os-volume_attachments/959fac13-c58a-4173-adbc-bc8a4a6367de => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 12:07:04.527110 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-17c3a8cd-76a1-4f58-96b4-c8ab18ae71b2 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:07:04.531107 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:04.531800 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:04.539373 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-17c3a8cd-76a1-4f58-96b4-c8ab18ae71b2 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:04.540139 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-17c3a8cd-76a1-4f58-96b4-c8ab18ae71b2 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:04.540577 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-17c3a8cd-76a1-4f58-96b4-c8ab18ae71b2 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:04.571042 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-17c3a8cd-76a1-4f58-96b4-c8ab18ae71b2 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Going to try to stop instance {{(pid=118995) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 12:07:04.636290 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-17c3a8cd-76a1-4f58-96b4-c8ab18ae71b2 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "POST /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91/action" status: 202 len: 0 microversion: 2.1 time: 0.113207 Oct 11 12:07:04.637313 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 308/605] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Oct 11 12:07:04 2022] POST /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 12:07:04.647196 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-fd42da68-92ea-47d1-ba61-8b2b4f12848e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:04.648013 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-fd42da68-92ea-47d1-ba61-8b2b4f12848e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:04.661920 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-fd42da68-92ea-47d1-ba61-8b2b4f12848e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:04.664516 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-fd42da68-92ea-47d1-ba61-8b2b4f12848e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:04.665631 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-fd42da68-92ea-47d1-ba61-8b2b4f12848e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:04.668024 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-fd42da68-92ea-47d1-ba61-8b2b4f12848e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:04.669534 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-fd42da68-92ea-47d1-ba61-8b2b4f12848e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:04.671202 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-fd42da68-92ea-47d1-ba61-8b2b4f12848e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:04.889381 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-fd42da68-92ea-47d1-ba61-8b2b4f12848e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:04.898846 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-fd42da68-92ea-47d1-ba61-8b2b4f12848e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1678 microversion: 2.1 time: 0.256425 Oct 11 12:07:04.899435 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 298/606] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:04 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1678 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:07:06.279648 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b61defc8-f4b7-4190-8c4c-fc2da3b36eb6 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:06.280353 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-b61defc8-f4b7-4190-8c4c-fc2da3b36eb6 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:06.289216 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b61defc8-f4b7-4190-8c4c-fc2da3b36eb6 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:06.290723 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b61defc8-f4b7-4190-8c4c-fc2da3b36eb6 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:06.295139 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b61defc8-f4b7-4190-8c4c-fc2da3b36eb6 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:06.296306 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b61defc8-f4b7-4190-8c4c-fc2da3b36eb6 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:06.297182 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b61defc8-f4b7-4190-8c4c-fc2da3b36eb6 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:06.303192 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b61defc8-f4b7-4190-8c4c-fc2da3b36eb6 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:06.569040 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-b61defc8-f4b7-4190-8c4c-fc2da3b36eb6 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:06.584618 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b61defc8-f4b7-4190-8c4c-fc2da3b36eb6 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1678 microversion: 2.1 time: 0.663683 Oct 11 12:07:06.586514 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 309/607] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:05 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1678 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:07:07.614443 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-ecb4346f-494a-432f-8899-6920661967c1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:07.616781 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-ecb4346f-494a-432f-8899-6920661967c1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:07.632802 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ecb4346f-494a-432f-8899-6920661967c1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:07.634230 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ecb4346f-494a-432f-8899-6920661967c1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:07.635536 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ecb4346f-494a-432f-8899-6920661967c1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:07.637241 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ecb4346f-494a-432f-8899-6920661967c1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:07.639127 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ecb4346f-494a-432f-8899-6920661967c1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:07.640572 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ecb4346f-494a-432f-8899-6920661967c1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:07.871130 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-ecb4346f-494a-432f-8899-6920661967c1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:07.881834 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-ecb4346f-494a-432f-8899-6920661967c1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1678 microversion: 2.1 time: 0.275201 Oct 11 12:07:07.894963 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 299/608] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:07 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1678 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:07:08.083835 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-acf0fe57-66dc-4404-bb86-68e5adec9cfd tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:08.084971 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-acf0fe57-66dc-4404-bb86-68e5adec9cfd tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:08.099265 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-acf0fe57-66dc-4404-bb86-68e5adec9cfd tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:08.100146 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-acf0fe57-66dc-4404-bb86-68e5adec9cfd tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:08.100927 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-acf0fe57-66dc-4404-bb86-68e5adec9cfd tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:08.102190 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-acf0fe57-66dc-4404-bb86-68e5adec9cfd tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:08.103368 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-acf0fe57-66dc-4404-bb86-68e5adec9cfd tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:08.104400 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-acf0fe57-66dc-4404-bb86-68e5adec9cfd tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:08.320578 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-acf0fe57-66dc-4404-bb86-68e5adec9cfd tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lazy-loading 'services' on Instance uuid 1be649cc-66ab-45f6-8477-19a7263944fa {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:07:08.531940 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-acf0fe57-66dc-4404-bb86-68e5adec9cfd tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa/os-volume_attachments/476dd514-0fa6-410a-b047-2fe7446ba84e" status: 202 len: 0 microversion: 2.1 time: 0.456968 Oct 11 12:07:08.537603 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 310/609] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Oct 11 12:07:08 2022] DELETE /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa/os-volume_attachments/476dd514-0fa6-410a-b047-2fe7446ba84e => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 12:07:08.554408 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-34233930-3c81-44cd-8fb4-4e942e96bb26 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:08.557786 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-34233930-3c81-44cd-8fb4-4e942e96bb26 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:08.576420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-34233930-3c81-44cd-8fb4-4e942e96bb26 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:08.577326 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-34233930-3c81-44cd-8fb4-4e942e96bb26 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:08.581596 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-34233930-3c81-44cd-8fb4-4e942e96bb26 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:08.582729 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-34233930-3c81-44cd-8fb4-4e942e96bb26 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:08.583748 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-34233930-3c81-44cd-8fb4-4e942e96bb26 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:08.586654 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-34233930-3c81-44cd-8fb4-4e942e96bb26 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:08.674028 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-34233930-3c81-44cd-8fb4-4e942e96bb26 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127369 Oct 11 12:07:08.696350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 300/610] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Oct 11 12:07:08 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:07:08.950773 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-19cf3f10-2657-422e-8498-320e7072abde tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:08.970013 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-19cf3f10-2657-422e-8498-320e7072abde tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:08.998491 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-19cf3f10-2657-422e-8498-320e7072abde tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:08.999477 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-19cf3f10-2657-422e-8498-320e7072abde tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:09.000640 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-19cf3f10-2657-422e-8498-320e7072abde tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:09.002399 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-19cf3f10-2657-422e-8498-320e7072abde tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:09.003625 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-19cf3f10-2657-422e-8498-320e7072abde tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:09.004745 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-19cf3f10-2657-422e-8498-320e7072abde tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:09.339478 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-19cf3f10-2657-422e-8498-320e7072abde tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:09.350156 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-19cf3f10-2657-422e-8498-320e7072abde tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1678 microversion: 2.1 time: 0.418157 Oct 11 12:07:09.351859 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 311/611] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:08 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1678 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:07:09.704753 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-c7899086-2766-42db-9abc-2a1b0aaed90b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:09.713855 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-c7899086-2766-42db-9abc-2a1b0aaed90b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:09.744092 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c7899086-2766-42db-9abc-2a1b0aaed90b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:09.745339 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c7899086-2766-42db-9abc-2a1b0aaed90b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:09.746377 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c7899086-2766-42db-9abc-2a1b0aaed90b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:09.756271 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c7899086-2766-42db-9abc-2a1b0aaed90b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:09.757234 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c7899086-2766-42db-9abc-2a1b0aaed90b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:09.772605 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c7899086-2766-42db-9abc-2a1b0aaed90b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:09.882429 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-c7899086-2766-42db-9abc-2a1b0aaed90b tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.188099 Oct 11 12:07:09.893026 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 301/612] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Oct 11 12:07:09 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa/os-volume_attachments => generated 197 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:07:10.388828 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e7991744-b6be-47de-becb-75306fbafc0e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:10.389636 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e7991744-b6be-47de-becb-75306fbafc0e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:10.407723 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e7991744-b6be-47de-becb-75306fbafc0e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:10.408270 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e7991744-b6be-47de-becb-75306fbafc0e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:10.408741 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e7991744-b6be-47de-becb-75306fbafc0e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:10.409485 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e7991744-b6be-47de-becb-75306fbafc0e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:10.409945 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e7991744-b6be-47de-becb-75306fbafc0e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:10.410374 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e7991744-b6be-47de-becb-75306fbafc0e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:10.709471 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e7991744-b6be-47de-becb-75306fbafc0e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:10.766006 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e7991744-b6be-47de-becb-75306fbafc0e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1678 microversion: 2.1 time: 0.380883 Oct 11 12:07:10.778666 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 312/613] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:10 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1678 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:07:10.900197 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-8a07bf42-45c0-4a7f-bdbf-e699df1cb5af tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:10.903588 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-8a07bf42-45c0-4a7f-bdbf-e699df1cb5af tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:10.915497 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8a07bf42-45c0-4a7f-bdbf-e699df1cb5af tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:10.916483 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8a07bf42-45c0-4a7f-bdbf-e699df1cb5af tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:10.917869 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8a07bf42-45c0-4a7f-bdbf-e699df1cb5af tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:10.920354 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8a07bf42-45c0-4a7f-bdbf-e699df1cb5af tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:10.921172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8a07bf42-45c0-4a7f-bdbf-e699df1cb5af tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:10.922125 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8a07bf42-45c0-4a7f-bdbf-e699df1cb5af tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:10.993178 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-8a07bf42-45c0-4a7f-bdbf-e699df1cb5af tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.097240 Oct 11 12:07:10.994200 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 302/614] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Oct 11 12:07:10 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa/os-volume_attachments => generated 25 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 12:07:11.179191 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-55b78fdf-f01b-440c-a908-73295b0f2bf8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:11.180075 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-55b78fdf-f01b-440c-a908-73295b0f2bf8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:11.191706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-55b78fdf-f01b-440c-a908-73295b0f2bf8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:11.192582 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-55b78fdf-f01b-440c-a908-73295b0f2bf8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:11.193521 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-55b78fdf-f01b-440c-a908-73295b0f2bf8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:11.199319 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-55b78fdf-f01b-440c-a908-73295b0f2bf8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:11.208140 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-55b78fdf-f01b-440c-a908-73295b0f2bf8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:11.209176 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-55b78fdf-f01b-440c-a908-73295b0f2bf8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:11.265863 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-55b78fdf-f01b-440c-a908-73295b0f2bf8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Going to try to terminate instance {{(pid=118995) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 12:07:11.417625 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-55b78fdf-f01b-440c-a908-73295b0f2bf8 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 204 len: 0 microversion: 2.1 time: 0.245759 Oct 11 12:07:11.419048 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 313/615] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Oct 11 12:07:11 2022] DELETE /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 0 bytes in 249 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 12:07:11.432583 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-2cf2b67c-8c78-434a-b6cf-56eb515e9ce3 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:11.433508 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-2cf2b67c-8c78-434a-b6cf-56eb515e9ce3 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:11.451040 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2cf2b67c-8c78-434a-b6cf-56eb515e9ce3 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:11.451040 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2cf2b67c-8c78-434a-b6cf-56eb515e9ce3 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:11.451040 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2cf2b67c-8c78-434a-b6cf-56eb515e9ce3 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:11.453116 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2cf2b67c-8c78-434a-b6cf-56eb515e9ce3 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:11.460859 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2cf2b67c-8c78-434a-b6cf-56eb515e9ce3 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:11.461978 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2cf2b67c-8c78-434a-b6cf-56eb515e9ce3 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:11.717386 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-2cf2b67c-8c78-434a-b6cf-56eb515e9ce3 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:11.729230 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-2cf2b67c-8c78-434a-b6cf-56eb515e9ce3 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1689 microversion: 2.1 time: 0.303621 Oct 11 12:07:11.730267 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 303/616] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:11 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1689 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:07:11.779797 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5ad3a4ec-5f7e-4960-b3a7-4cba53ff30d0 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Action: 'create', calling method: .version_select at 0x7fd406862af0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1438686999", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAawXsEeQVt3y/0o8YKjYLOUFIMxxa5TFOLWtRrPg/eXq6Pi3v+rCrwhaQZGRKJUMG76ThoMbzBF6vlWpwMHBMzEy5COgqlsExUoSwyjCOxIa29mfnoXJkr5E1TtEdLsrA=="}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:07:11.797914 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-5ad3a4ec-5f7e-4960-b3a7-4cba53ff30d0 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Getting quotas for project ef7f8c1858da4f73925e63ea06100eab. Resources: {'key_pairs'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 12:07:11.803120 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-5ad3a4ec-5f7e-4960-b3a7-4cba53ff30d0 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Getting quotas for user edb722b67a804915bf38f34b67845bc9 and project ef7f8c1858da4f73925e63ea06100eab. Resources: {'key_pairs'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 12:07:11.823501 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-0109cf81-d311-4a80-9d02-7a5ca43c6610 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:11.824402 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-0109cf81-d311-4a80-9d02-7a5ca43c6610 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:11.835216 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0109cf81-d311-4a80-9d02-7a5ca43c6610 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:11.835824 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0109cf81-d311-4a80-9d02-7a5ca43c6610 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:11.836570 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0109cf81-d311-4a80-9d02-7a5ca43c6610 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:11.837390 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5ad3a4ec-5f7e-4960-b3a7-4cba53ff30d0 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.203075 Oct 11 12:07:11.838063 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0109cf81-d311-4a80-9d02-7a5ca43c6610 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:11.838816 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 314/617] 10.222.0.59 () {60 vars in 1159 bytes} [Tue Oct 11 12:07:11 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:07:11.839021 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0109cf81-d311-4a80-9d02-7a5ca43c6610 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:11.839716 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0109cf81-d311-4a80-9d02-7a5ca43c6610 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:12.056623 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-0109cf81-d311-4a80-9d02-7a5ca43c6610 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:12.067124 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-0109cf81-d311-4a80-9d02-7a5ca43c6610 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1678 microversion: 2.1 time: 0.249488 Oct 11 12:07:12.067816 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 304/618] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:11 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1678 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:07:12.765567 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-4e51a9ff-ce93-462f-ba15-cb91c4a35537 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:12.775275 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-4e51a9ff-ce93-462f-ba15-cb91c4a35537 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:12.790493 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4e51a9ff-ce93-462f-ba15-cb91c4a35537 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:12.804616 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4e51a9ff-ce93-462f-ba15-cb91c4a35537 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:12.806733 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4e51a9ff-ce93-462f-ba15-cb91c4a35537 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:12.808517 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4e51a9ff-ce93-462f-ba15-cb91c4a35537 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:12.809323 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4e51a9ff-ce93-462f-ba15-cb91c4a35537 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:12.809829 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4e51a9ff-ce93-462f-ba15-cb91c4a35537 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:13.069442 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-4e51a9ff-ce93-462f-ba15-cb91c4a35537 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:13.083529 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-4e51a9ff-ce93-462f-ba15-cb91c4a35537 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1689 microversion: 2.1 time: 0.325225 Oct 11 12:07:13.092235 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-3bfd6698-e487-4ed6-8760-835875d8ff22 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:13.093482 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-3bfd6698-e487-4ed6-8760-835875d8ff22 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:13.099339 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 315/619] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:12 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1689 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:07:13.101129 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3bfd6698-e487-4ed6-8760-835875d8ff22 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:13.102008 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3bfd6698-e487-4ed6-8760-835875d8ff22 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:13.102881 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3bfd6698-e487-4ed6-8760-835875d8ff22 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:13.103786 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3bfd6698-e487-4ed6-8760-835875d8ff22 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:13.104413 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3bfd6698-e487-4ed6-8760-835875d8ff22 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:13.104898 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3bfd6698-e487-4ed6-8760-835875d8ff22 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:13.321379 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-3bfd6698-e487-4ed6-8760-835875d8ff22 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:13.335974 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-3bfd6698-e487-4ed6-8760-835875d8ff22 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1678 microversion: 2.1 time: 0.247667 Oct 11 12:07:13.337045 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 305/620] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:13 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1678 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:07:14.118673 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-eed3a7e6-fa90-4d9a-bd51-fa87d829c688 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:14.119437 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-eed3a7e6-fa90-4d9a-bd51-fa87d829c688 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:14.128025 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eed3a7e6-fa90-4d9a-bd51-fa87d829c688 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:14.129352 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eed3a7e6-fa90-4d9a-bd51-fa87d829c688 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:14.130303 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eed3a7e6-fa90-4d9a-bd51-fa87d829c688 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:14.131710 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eed3a7e6-fa90-4d9a-bd51-fa87d829c688 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:14.132584 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eed3a7e6-fa90-4d9a-bd51-fa87d829c688 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:14.133152 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eed3a7e6-fa90-4d9a-bd51-fa87d829c688 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:14.314026 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-eed3a7e6-fa90-4d9a-bd51-fa87d829c688 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:14.333998 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-eed3a7e6-fa90-4d9a-bd51-fa87d829c688 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1689 microversion: 2.1 time: 0.219016 Oct 11 12:07:14.340458 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 316/621] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:14 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1689 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:07:14.372641 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-eaca1f08-f694-411c-a160-41399e01c084 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:14.373679 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-eaca1f08-f694-411c-a160-41399e01c084 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:14.383293 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eaca1f08-f694-411c-a160-41399e01c084 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:14.384011 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eaca1f08-f694-411c-a160-41399e01c084 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:14.384661 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eaca1f08-f694-411c-a160-41399e01c084 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:14.385630 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eaca1f08-f694-411c-a160-41399e01c084 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:14.386280 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eaca1f08-f694-411c-a160-41399e01c084 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:14.386896 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eaca1f08-f694-411c-a160-41399e01c084 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:14.589739 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-eaca1f08-f694-411c-a160-41399e01c084 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:14.603446 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-eaca1f08-f694-411c-a160-41399e01c084 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1678 microversion: 2.1 time: 0.235597 Oct 11 12:07:14.605043 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 306/622] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:14 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1678 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:07:15.365401 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-916e4caf-5d08-4d63-b156-bc8b3e6d2f4d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:15.366823 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-916e4caf-5d08-4d63-b156-bc8b3e6d2f4d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:15.375117 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-916e4caf-5d08-4d63-b156-bc8b3e6d2f4d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:15.376062 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-916e4caf-5d08-4d63-b156-bc8b3e6d2f4d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:15.376840 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-916e4caf-5d08-4d63-b156-bc8b3e6d2f4d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:15.377764 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-916e4caf-5d08-4d63-b156-bc8b3e6d2f4d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:15.378417 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-916e4caf-5d08-4d63-b156-bc8b3e6d2f4d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:15.379049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-916e4caf-5d08-4d63-b156-bc8b3e6d2f4d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:15.630146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-f9afdf6a-0685-48b7-878e-78bc67d96d6b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:15.630947 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-f9afdf6a-0685-48b7-878e-78bc67d96d6b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:15.638436 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f9afdf6a-0685-48b7-878e-78bc67d96d6b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:15.638990 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f9afdf6a-0685-48b7-878e-78bc67d96d6b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:15.639412 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f9afdf6a-0685-48b7-878e-78bc67d96d6b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:15.640421 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f9afdf6a-0685-48b7-878e-78bc67d96d6b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:15.641064 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f9afdf6a-0685-48b7-878e-78bc67d96d6b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:15.641652 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f9afdf6a-0685-48b7-878e-78bc67d96d6b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:15.645983 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-916e4caf-5d08-4d63-b156-bc8b3e6d2f4d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:15.670398 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-916e4caf-5d08-4d63-b156-bc8b3e6d2f4d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1689 microversion: 2.1 time: 0.307983 Oct 11 12:07:15.685498 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 317/623] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:15 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1689 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:07:15.861783 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-f9afdf6a-0685-48b7-878e-78bc67d96d6b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:15.875832 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-f9afdf6a-0685-48b7-878e-78bc67d96d6b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1655 microversion: 2.1 time: 0.250834 Oct 11 12:07:15.884454 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 307/624] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:15 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1655 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:07:15.917460 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-fc93b6a0-a263-4539-bdee-f1d152b0c817 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:07:15.942394 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fc93b6a0-a263-4539-bdee-f1d152b0c817 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:15.944693 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fc93b6a0-a263-4539-bdee-f1d152b0c817 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:15.945477 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fc93b6a0-a263-4539-bdee-f1d152b0c817 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:16.000280 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-fc93b6a0-a263-4539-bdee-f1d152b0c817 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Going to try to start instance {{(pid=118995) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 12:07:16.110300 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-fc93b6a0-a263-4539-bdee-f1d152b0c817 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "POST /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91/action" status: 202 len: 0 microversion: 2.1 time: 0.199747 Oct 11 12:07:16.112431 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 318/625] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Oct 11 12:07:15 2022] POST /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91/action => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 12:07:16.130157 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-241e117a-fe56-4980-a29b-dd609366f4e0 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:16.135484 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-241e117a-fe56-4980-a29b-dd609366f4e0 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:16.148326 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-241e117a-fe56-4980-a29b-dd609366f4e0 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:16.149607 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-241e117a-fe56-4980-a29b-dd609366f4e0 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:16.150374 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-241e117a-fe56-4980-a29b-dd609366f4e0 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:16.154464 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-241e117a-fe56-4980-a29b-dd609366f4e0 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:16.155077 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-241e117a-fe56-4980-a29b-dd609366f4e0 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:16.155666 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-241e117a-fe56-4980-a29b-dd609366f4e0 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:16.428296 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-241e117a-fe56-4980-a29b-dd609366f4e0 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:16.445438 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-241e117a-fe56-4980-a29b-dd609366f4e0 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1664 microversion: 2.1 time: 0.326210 Oct 11 12:07:16.446302 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 308/626] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:16 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1664 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:07:16.716529 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2e0b451b-9e0e-4101-af60-2b665eaf00eb tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:16.719622 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2e0b451b-9e0e-4101-af60-2b665eaf00eb tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:16.737136 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2e0b451b-9e0e-4101-af60-2b665eaf00eb tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:16.737924 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2e0b451b-9e0e-4101-af60-2b665eaf00eb tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:16.738535 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2e0b451b-9e0e-4101-af60-2b665eaf00eb tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:16.739573 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2e0b451b-9e0e-4101-af60-2b665eaf00eb tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:16.740411 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2e0b451b-9e0e-4101-af60-2b665eaf00eb tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:16.741003 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2e0b451b-9e0e-4101-af60-2b665eaf00eb tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:17.059658 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2e0b451b-9e0e-4101-af60-2b665eaf00eb tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:17.082869 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2e0b451b-9e0e-4101-af60-2b665eaf00eb tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1621 microversion: 2.1 time: 0.373939 Oct 11 12:07:17.084016 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 319/627] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:16 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1621 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:07:17.132577 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-c9e2df28-cb02-45a1-9066-0f7a01fea7b2 req-d205f23a-0d15-438c-84b4-09e570e30b88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1be649cc-66ab-45f6-8477-19a7263944fa", "name": "network-vif-deleted", "tag": "264946f8-afe2-4e00-bb9a-a5a0027ee444"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:07:17.147292 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-c9e2df28-cb02-45a1-9066-0f7a01fea7b2 req-d205f23a-0d15-438c-84b4-09e570e30b88 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:17.148452 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-c9e2df28-cb02-45a1-9066-0f7a01fea7b2 req-d205f23a-0d15-438c-84b4-09e570e30b88 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:17.149269 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-c9e2df28-cb02-45a1-9066-0f7a01fea7b2 req-d205f23a-0d15-438c-84b4-09e570e30b88 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:17.175994 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-c9e2df28-cb02-45a1-9066-0f7a01fea7b2 req-d205f23a-0d15-438c-84b4-09e570e30b88 service nova] Creating event network-vif-deleted:264946f8-afe2-4e00-bb9a-a5a0027ee444 for instance 1be649cc-66ab-45f6-8477-19a7263944fa on hv-cinder-82099 Oct 11 12:07:17.201112 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-c9e2df28-cb02-45a1-9066-0f7a01fea7b2 req-d205f23a-0d15-438c-84b4-09e570e30b88 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072399 Oct 11 12:07:17.202239 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 309/628] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:07:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:07:17.485176 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b3e47e81-cf18-41ac-b385-42321fe274e5 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:17.485786 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-b3e47e81-cf18-41ac-b385-42321fe274e5 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:17.499684 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b3e47e81-cf18-41ac-b385-42321fe274e5 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:17.507119 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b3e47e81-cf18-41ac-b385-42321fe274e5 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:17.508877 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b3e47e81-cf18-41ac-b385-42321fe274e5 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:17.509866 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b3e47e81-cf18-41ac-b385-42321fe274e5 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:17.512920 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b3e47e81-cf18-41ac-b385-42321fe274e5 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:17.514766 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b3e47e81-cf18-41ac-b385-42321fe274e5 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:17.842906 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-b3e47e81-cf18-41ac-b385-42321fe274e5 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:17.858779 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b3e47e81-cf18-41ac-b385-42321fe274e5 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1664 microversion: 2.1 time: 0.377266 Oct 11 12:07:17.860095 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 320/629] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:17 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1664 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:07:18.108961 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-e0aee894-f760-4cd9-8136-ab6a29212e5c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:18.109669 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-e0aee894-f760-4cd9-8136-ab6a29212e5c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:18.122679 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e0aee894-f760-4cd9-8136-ab6a29212e5c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:18.124222 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e0aee894-f760-4cd9-8136-ab6a29212e5c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:18.124692 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e0aee894-f760-4cd9-8136-ab6a29212e5c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:18.126069 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e0aee894-f760-4cd9-8136-ab6a29212e5c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:18.127009 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e0aee894-f760-4cd9-8136-ab6a29212e5c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:18.127848 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e0aee894-f760-4cd9-8136-ab6a29212e5c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:18.175414 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e0aee894-f760-4cd9-8136-ab6a29212e5c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:18.176502 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e0aee894-f760-4cd9-8136-ab6a29212e5c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:18.176885 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e0aee894-f760-4cd9-8136-ab6a29212e5c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:18.177531 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.objects.instance [None req-e0aee894-f760-4cd9-8136-ab6a29212e5c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lazy-loading 'fault' on Instance uuid 1be649cc-66ab-45f6-8477-19a7263944fa {{(pid=118994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:07:18.243087 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-e0aee894-f760-4cd9-8136-ab6a29212e5c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:18.254988 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-e0aee894-f760-4cd9-8136-ab6a29212e5c tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 200 len: 1335 microversion: 2.1 time: 0.150415 Oct 11 12:07:18.258312 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 310/630] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:18 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 1335 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:07:18.895507 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2b56023e-4221-45c9-a4c4-98e69bcff5e1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:18.896783 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2b56023e-4221-45c9-a4c4-98e69bcff5e1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:18.907689 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2b56023e-4221-45c9-a4c4-98e69bcff5e1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:18.908902 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2b56023e-4221-45c9-a4c4-98e69bcff5e1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:18.909325 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2b56023e-4221-45c9-a4c4-98e69bcff5e1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:18.910663 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2b56023e-4221-45c9-a4c4-98e69bcff5e1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:18.911527 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2b56023e-4221-45c9-a4c4-98e69bcff5e1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:18.912258 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2b56023e-4221-45c9-a4c4-98e69bcff5e1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:18.920970 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:19.121215 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2b56023e-4221-45c9-a4c4-98e69bcff5e1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:19.132327 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2b56023e-4221-45c9-a4c4-98e69bcff5e1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1668 microversion: 2.1 time: 0.247404 Oct 11 12:07:19.133071 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 321/631] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:18 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1668 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:07:19.304158 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-db539da5-73b3-4288-97fb-2e4ba13bb26d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:19.304825 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-db539da5-73b3-4288-97fb-2e4ba13bb26d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 1be649cc-66ab-45f6-8477-19a7263944fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:19.312308 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-db539da5-73b3-4288-97fb-2e4ba13bb26d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:19.312907 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-db539da5-73b3-4288-97fb-2e4ba13bb26d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:19.313394 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-db539da5-73b3-4288-97fb-2e4ba13bb26d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:19.314147 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-db539da5-73b3-4288-97fb-2e4ba13bb26d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:19.314682 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-db539da5-73b3-4288-97fb-2e4ba13bb26d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:19.315152 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-db539da5-73b3-4288-97fb-2e4ba13bb26d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:19.335332 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.wsgi [None req-db539da5-73b3-4288-97fb-2e4ba13bb26d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] HTTP exception thrown: Instance 1be649cc-66ab-45f6-8477-19a7263944fa could not be found. Oct 11 12:07:19.337205 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-db539da5-73b3-4288-97fb-2e4ba13bb26d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Request method failure captured: Oct 11 12:07:19.337205 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: request: GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa HTTP/1.1 Oct 11 12:07:19.337205 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept: application/json Oct 11 12:07:19.337205 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept-Encoding: identity Oct 11 12:07:19.337205 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Connection: close Oct 11 12:07:19.337205 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Length: 0 Oct 11 12:07:19.337205 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Type: application/json Oct 11 12:07:19.337205 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Host: 10.222.0.59 Oct 11 12:07:19.337205 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Openstack-System-Scope: None Oct 11 12:07:19.337205 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: User-Agent: python-urllib3/1.26.12 Oct 11 12:07:19.337205 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Auth-Token: gAAAAABjRVrJaSzGAAsqN9YGFXD6DdIsLyt5xdpqMt74hKm0_jmhSi4ZXRo-fmMLSlB8g5keLfi_7ztQVJjqAgS19u6mD9NIFMQvvckksKoE6xupAQa0kDeitdjWA3oiAr9oO9Gi_CEanhcbJ1BGNm6XToopMs81aIIr4CbmeaUmYW-C9S4ctTo Oct 11 12:07:19.337205 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Id: None Oct 11 12:07:19.337205 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Name: None Oct 11 12:07:19.337205 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Identity-Status: Confirmed Oct 11 12:07:19.337205 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Is-Admin-Project: True Oct 11 12:07:19.337205 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Id: default Oct 11 12:07:19.337205 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Name: Default Oct 11 12:07:19.337205 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Id: e3e6a648f46646cea42b910d02e0628f Oct 11 12:07:19.337205 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-166493339 Oct 11 12:07:19.337205 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Role: reader,member Oct 11 12:07:19.337205 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Roles: reader,member Oct 11 12:07:19.340273 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e3e6a648f46646cea42b910d02e0628f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e3e6a648f46646cea42b910d02e0628f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e3e6a648f46646cea42b910d02e0628f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e3e6a648f46646cea42b910d02e0628f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:07:19.340273 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant: tempest-ServerRescueNegativeTestJSON-166493339 Oct 11 12:07:19.340273 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Id: e3e6a648f46646cea42b910d02e0628f Oct 11 12:07:19.340273 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-166493339 Oct 11 12:07:19.340273 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User: tempest-ServerRescueNegativeTestJSON-166493339-project Oct 11 12:07:19.340273 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Id: default Oct 11 12:07:19.340273 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Name: Default Oct 11 12:07:19.340273 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Id: c58107eee1b94541a330c26d7b82a53b Oct 11 12:07:19.340273 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Name: tempest-ServerRescueNegativeTestJSON-166493339-project Oct 11 12:07:19.340273 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: method: > Oct 11 12:07:19.340273 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: exception: Instance 1be649cc-66ab-45f6-8477-19a7263944fa could not be found. Oct 11 12:07:19.340273 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: action_args: {'id': '1be649cc-66ab-45f6-8477-19a7263944fa'} Oct 11 12:07:19.342507 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:07:19.342507 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:07:19.342507 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:07:19.342507 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:07:19.342507 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:07:19.342507 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:07:19.342507 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:07:19.342507 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:07:19.342507 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:07:19.342507 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:07:19.342507 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1be649cc-66ab-45f6-8477-19a7263944fa could not be found. Oct 11 12:07:19.342507 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:07:19.342507 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:07:19.342507 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:07:19.342507 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:07:19.342507 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:07:19.342507 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:07:19.342507 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:07:19.342507 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:07:19.342507 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:07:19.345085 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:07:19.345085 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 12:07:19.345085 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 12:07:19.345085 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:07:19.345085 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:07:19.345085 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:07:19.345085 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:07:19.345085 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1be649cc-66ab-45f6-8477-19a7263944fa could not be found. Oct 11 12:07:19.345085 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:07:19.345085 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:07:19.345085 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:07:19.345085 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:07:19.345085 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:07:19.345085 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:07:19.345085 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:07:19.345085 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:07:19.345085 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1be649cc-66ab-45f6-8477-19a7263944fa could not be found. Oct 11 12:07:19.345085 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:07:19.351358 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-db539da5-73b3-4288-97fb-2e4ba13bb26d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Returning 404 to user: Instance 1be649cc-66ab-45f6-8477-19a7263944fa could not be found. {{(pid=118994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:07:19.351358 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-db539da5-73b3-4288-97fb-2e4ba13bb26d tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa" status: 404 len: 111 microversion: 2.1 time: 0.040607 Oct 11 12:07:19.351358 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 311/632] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:19 2022] GET /compute/v2.1/servers/1be649cc-66ab-45f6-8477-19a7263944fa => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:07:19.356652 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5bd3f8cb-9650-42b7-adef-29f546d77104 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '.version_select at 0x7fd4068b1160>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:19.379994 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5bd3f8cb-9650-42b7-adef-29f546d77104 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-594661262" status: 202 len: 0 microversion: 2.1 time: 0.031107 Oct 11 12:07:19.382618 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 322/633] 10.222.0.59 () {58 vars in 1218 bytes} [Tue Oct 11 12:07:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-594661262 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 12:07:22.377017 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-24f654cc-79d5-4676-bff4-4d0191296ef6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:22.377988 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-24f654cc-79d5-4676-bff4-4d0191296ef6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:22.389292 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-24f654cc-79d5-4676-bff4-4d0191296ef6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:22.390144 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-24f654cc-79d5-4676-bff4-4d0191296ef6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:22.391014 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-24f654cc-79d5-4676-bff4-4d0191296ef6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:22.392283 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-24f654cc-79d5-4676-bff4-4d0191296ef6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:22.393075 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-24f654cc-79d5-4676-bff4-4d0191296ef6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:22.394138 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-24f654cc-79d5-4676-bff4-4d0191296ef6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:22.448960 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-24f654cc-79d5-4676-bff4-4d0191296ef6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Going to try to terminate instance {{(pid=118994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 12:07:22.520385 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:22.595816 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-24f654cc-79d5-4676-bff4-4d0191296ef6 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "DELETE /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 204 len: 0 microversion: 2.1 time: 0.226435 Oct 11 12:07:22.596597 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 312/634] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Oct 11 12:07:22 2022] DELETE /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 12:07:22.603863 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=4 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:22.611112 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a8903c71-d414-49f3-92ba-54be1b8c4ed4 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:22.611819 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a8903c71-d414-49f3-92ba-54be1b8c4ed4 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:22.619734 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a8903c71-d414-49f3-92ba-54be1b8c4ed4 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:22.620389 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a8903c71-d414-49f3-92ba-54be1b8c4ed4 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:22.621030 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a8903c71-d414-49f3-92ba-54be1b8c4ed4 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:22.622011 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a8903c71-d414-49f3-92ba-54be1b8c4ed4 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:22.622538 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a8903c71-d414-49f3-92ba-54be1b8c4ed4 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:22.623082 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a8903c71-d414-49f3-92ba-54be1b8c4ed4 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:22.786905 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a8903c71-d414-49f3-92ba-54be1b8c4ed4 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:22.796487 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a8903c71-d414-49f3-92ba-54be1b8c4ed4 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1507 microversion: 2.1 time: 0.194366 Oct 11 12:07:22.797735 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 323/635] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:22 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1507 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:07:23.825793 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-82b8367d-8e80-4e54-8481-3313de50572f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:23.826622 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-82b8367d-8e80-4e54-8481-3313de50572f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:23.834446 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-82b8367d-8e80-4e54-8481-3313de50572f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:23.835203 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-82b8367d-8e80-4e54-8481-3313de50572f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:23.835630 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-82b8367d-8e80-4e54-8481-3313de50572f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:23.836607 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-82b8367d-8e80-4e54-8481-3313de50572f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:23.837071 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-82b8367d-8e80-4e54-8481-3313de50572f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:23.837673 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-82b8367d-8e80-4e54-8481-3313de50572f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:24.039774 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-82b8367d-8e80-4e54-8481-3313de50572f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:24.048433 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-82b8367d-8e80-4e54-8481-3313de50572f tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1507 microversion: 2.1 time: 0.227027 Oct 11 12:07:24.049026 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 313/636] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:23 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1507 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:07:24.356709 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-0e014582-f209-4070-9df4-0d446426de79 req-8bb10d25-448b-4a7e-ab34-782c60febc7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70722a52-e702-4e13-a49a-6f2c1161ae35", "name": "network-vif-deleted", "tag": "615246f6-a650-4d01-8f0c-205bc002fd3d"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:07:24.386859 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-0e014582-f209-4070-9df4-0d446426de79 req-8bb10d25-448b-4a7e-ab34-782c60febc7a service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:24.387789 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-0e014582-f209-4070-9df4-0d446426de79 req-8bb10d25-448b-4a7e-ab34-782c60febc7a service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:24.388754 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-0e014582-f209-4070-9df4-0d446426de79 req-8bb10d25-448b-4a7e-ab34-782c60febc7a service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:24.410345 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-0e014582-f209-4070-9df4-0d446426de79 req-8bb10d25-448b-4a7e-ab34-782c60febc7a service nova] Creating event network-vif-deleted:615246f6-a650-4d01-8f0c-205bc002fd3d for instance 70722a52-e702-4e13-a49a-6f2c1161ae35 on hv-cinder-82099 Oct 11 12:07:24.420202 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-0e014582-f209-4070-9df4-0d446426de79 req-8bb10d25-448b-4a7e-ab34-782c60febc7a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069554 Oct 11 12:07:24.421623 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 324/637] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:07:25.076351 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-b376fd00-cdc1-4185-ba3e-557e661c0116 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:25.077397 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-b376fd00-cdc1-4185-ba3e-557e661c0116 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:25.087900 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b376fd00-cdc1-4185-ba3e-557e661c0116 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:25.088711 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b376fd00-cdc1-4185-ba3e-557e661c0116 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:25.089239 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b376fd00-cdc1-4185-ba3e-557e661c0116 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:25.090121 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b376fd00-cdc1-4185-ba3e-557e661c0116 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:25.090640 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b376fd00-cdc1-4185-ba3e-557e661c0116 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:25.091229 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b376fd00-cdc1-4185-ba3e-557e661c0116 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:25.132091 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b376fd00-cdc1-4185-ba3e-557e661c0116 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:25.132590 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b376fd00-cdc1-4185-ba3e-557e661c0116 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:25.133140 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b376fd00-cdc1-4185-ba3e-557e661c0116 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:25.133612 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.objects.instance [None req-b376fd00-cdc1-4185-ba3e-557e661c0116 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lazy-loading 'fault' on Instance uuid 70722a52-e702-4e13-a49a-6f2c1161ae35 {{(pid=118994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:07:25.198681 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-b376fd00-cdc1-4185-ba3e-557e661c0116 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:25.212712 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-b376fd00-cdc1-4185-ba3e-557e661c0116 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 200 len: 1311 microversion: 2.1 time: 0.142200 Oct 11 12:07:25.213664 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 314/638] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:25 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 1311 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:07:26.239803 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e7ad492b-5cb7-4514-a890-61db966cfd99 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:26.240442 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e7ad492b-5cb7-4514-a890-61db966cfd99 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: 70722a52-e702-4e13-a49a-6f2c1161ae35] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:26.247461 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e7ad492b-5cb7-4514-a890-61db966cfd99 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:26.247953 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e7ad492b-5cb7-4514-a890-61db966cfd99 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:26.248385 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e7ad492b-5cb7-4514-a890-61db966cfd99 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:26.249108 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e7ad492b-5cb7-4514-a890-61db966cfd99 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:26.249578 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e7ad492b-5cb7-4514-a890-61db966cfd99 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:26.250009 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e7ad492b-5cb7-4514-a890-61db966cfd99 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:26.265330 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-e7ad492b-5cb7-4514-a890-61db966cfd99 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] HTTP exception thrown: Instance 70722a52-e702-4e13-a49a-6f2c1161ae35 could not be found. Oct 11 12:07:26.267086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e7ad492b-5cb7-4514-a890-61db966cfd99 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Request method failure captured: Oct 11 12:07:26.267086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 HTTP/1.1 Oct 11 12:07:26.267086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 11 12:07:26.267086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 11 12:07:26.267086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Connection: close Oct 11 12:07:26.267086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 11 12:07:26.267086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 11 12:07:26.267086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Host: 10.222.0.59 Oct 11 12:07:26.267086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 11 12:07:26.267086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 11 12:07:26.267086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjRVrJaSzGAAsqN9YGFXD6DdIsLyt5xdpqMt74hKm0_jmhSi4ZXRo-fmMLSlB8g5keLfi_7ztQVJjqAgS19u6mD9NIFMQvvckksKoE6xupAQa0kDeitdjWA3oiAr9oO9Gi_CEanhcbJ1BGNm6XToopMs81aIIr4CbmeaUmYW-C9S4ctTo Oct 11 12:07:26.267086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 11 12:07:26.267086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 11 12:07:26.267086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 11 12:07:26.267086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 11 12:07:26.267086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 11 12:07:26.267086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 11 12:07:26.267086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Id: e3e6a648f46646cea42b910d02e0628f Oct 11 12:07:26.267086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-166493339 Oct 11 12:07:26.267086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Role: reader,member Oct 11 12:07:26.267086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Roles: reader,member Oct 11 12:07:26.269927 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e3e6a648f46646cea42b910d02e0628f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e3e6a648f46646cea42b910d02e0628f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e3e6a648f46646cea42b910d02e0628f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e3e6a648f46646cea42b910d02e0628f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:07:26.269927 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-ServerRescueNegativeTestJSON-166493339 Oct 11 12:07:26.269927 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Id: e3e6a648f46646cea42b910d02e0628f Oct 11 12:07:26.269927 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-166493339 Oct 11 12:07:26.269927 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User: tempest-ServerRescueNegativeTestJSON-166493339-project Oct 11 12:07:26.269927 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 11 12:07:26.269927 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 11 12:07:26.269927 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Id: c58107eee1b94541a330c26d7b82a53b Oct 11 12:07:26.269927 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-ServerRescueNegativeTestJSON-166493339-project Oct 11 12:07:26.269927 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: method: > Oct 11 12:07:26.269927 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: exception: Instance 70722a52-e702-4e13-a49a-6f2c1161ae35 could not be found. Oct 11 12:07:26.269927 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: action_args: {'id': '70722a52-e702-4e13-a49a-6f2c1161ae35'} Oct 11 12:07:26.271428 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:07:26.271428 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:07:26.271428 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:07:26.271428 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:07:26.271428 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:07:26.271428 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:07:26.271428 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:07:26.271428 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:07:26.271428 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:07:26.271428 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:07:26.271428 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70722a52-e702-4e13-a49a-6f2c1161ae35 could not be found. Oct 11 12:07:26.271428 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:07:26.271428 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:07:26.271428 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:07:26.271428 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:07:26.271428 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:07:26.271428 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:07:26.271428 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:07:26.271428 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:07:26.271428 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:07:26.273274 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:07:26.273274 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 12:07:26.273274 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 12:07:26.273274 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:07:26.273274 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:07:26.273274 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:07:26.273274 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:07:26.273274 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70722a52-e702-4e13-a49a-6f2c1161ae35 could not be found. Oct 11 12:07:26.273274 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:07:26.273274 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:07:26.273274 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:07:26.273274 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:07:26.273274 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:07:26.273274 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:07:26.273274 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:07:26.273274 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:07:26.273274 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70722a52-e702-4e13-a49a-6f2c1161ae35 could not be found. Oct 11 12:07:26.273274 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:07:26.274862 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e7ad492b-5cb7-4514-a890-61db966cfd99 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Returning 404 to user: Instance 70722a52-e702-4e13-a49a-6f2c1161ae35 could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:07:26.274862 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e7ad492b-5cb7-4514-a890-61db966cfd99 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35" status: 404 len: 111 microversion: 2.1 time: 0.033929 Oct 11 12:07:26.274862 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 325/639] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:26 2022] GET /compute/v2.1/servers/70722a52-e702-4e13-a49a-6f2c1161ae35 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:07:26.283542 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-d6c264fa-0c61-467c-b944-5356cc1edf04 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:26.284467 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-d6c264fa-0c61-467c-b944-5356cc1edf04 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:26.295690 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d6c264fa-0c61-467c-b944-5356cc1edf04 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:26.296526 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d6c264fa-0c61-467c-b944-5356cc1edf04 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:26.297276 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d6c264fa-0c61-467c-b944-5356cc1edf04 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:26.298479 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d6c264fa-0c61-467c-b944-5356cc1edf04 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:26.299315 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d6c264fa-0c61-467c-b944-5356cc1edf04 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:26.300032 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d6c264fa-0c61-467c-b944-5356cc1edf04 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:26.350056 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-d6c264fa-0c61-467c-b944-5356cc1edf04 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Going to try to terminate instance {{(pid=118994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 12:07:26.452993 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-d6c264fa-0c61-467c-b944-5356cc1edf04 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "DELETE /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 204 len: 0 microversion: 2.1 time: 0.176152 Oct 11 12:07:26.454417 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 315/640] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Oct 11 12:07:26 2022] DELETE /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 0 bytes in 179 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 12:07:26.466090 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e2bc0b6e-5271-466b-8326-fa40a56576bf tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:26.467227 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e2bc0b6e-5271-466b-8326-fa40a56576bf tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:26.477248 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e2bc0b6e-5271-466b-8326-fa40a56576bf tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:26.477869 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e2bc0b6e-5271-466b-8326-fa40a56576bf tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:26.478373 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e2bc0b6e-5271-466b-8326-fa40a56576bf tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:26.479296 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e2bc0b6e-5271-466b-8326-fa40a56576bf tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:26.479835 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e2bc0b6e-5271-466b-8326-fa40a56576bf tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:26.480305 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e2bc0b6e-5271-466b-8326-fa40a56576bf tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:26.632220 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e2bc0b6e-5271-466b-8326-fa40a56576bf tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:26.641545 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e2bc0b6e-5271-466b-8326-fa40a56576bf tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1522 microversion: 2.1 time: 0.180504 Oct 11 12:07:26.642161 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 326/641] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:26 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:07:27.665705 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-56d152ed-90c8-4639-95dc-f503d8f5c91a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:27.666636 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-56d152ed-90c8-4639-95dc-f503d8f5c91a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:27.673925 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-56d152ed-90c8-4639-95dc-f503d8f5c91a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:27.674412 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-56d152ed-90c8-4639-95dc-f503d8f5c91a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:27.674869 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-56d152ed-90c8-4639-95dc-f503d8f5c91a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:27.675579 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-56d152ed-90c8-4639-95dc-f503d8f5c91a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:27.676026 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-56d152ed-90c8-4639-95dc-f503d8f5c91a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:27.676443 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-56d152ed-90c8-4639-95dc-f503d8f5c91a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:27.828097 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-56d152ed-90c8-4639-95dc-f503d8f5c91a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:27.840853 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-56d152ed-90c8-4639-95dc-f503d8f5c91a tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1522 microversion: 2.1 time: 0.179325 Oct 11 12:07:27.841826 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 316/642] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:27 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:07:28.865305 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-04cae00a-4837-4238-a516-bf7a147c3929 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:28.866078 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-04cae00a-4837-4238-a516-bf7a147c3929 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:28.873169 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04cae00a-4837-4238-a516-bf7a147c3929 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:28.873635 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04cae00a-4837-4238-a516-bf7a147c3929 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:28.874095 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04cae00a-4837-4238-a516-bf7a147c3929 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:28.874939 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04cae00a-4837-4238-a516-bf7a147c3929 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:28.875382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04cae00a-4837-4238-a516-bf7a147c3929 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:28.875802 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-04cae00a-4837-4238-a516-bf7a147c3929 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:29.235452 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-04cae00a-4837-4238-a516-bf7a147c3929 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c58107eee1b94541a330c26d7b82a53b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3e6a648f46646cea42b910d02e0628f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:29.250190 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-04cae00a-4837-4238-a516-bf7a147c3929 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 200 len: 1522 microversion: 2.1 time: 0.388860 Oct 11 12:07:29.252149 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 327/643] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:28 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 1522 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:07:29.443315 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-3f94e971-1678-4b48-8c87-1d6b25c385a0 req-93a5aa03-ead9-43eb-8da6-b0d6f41b9559 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6da2ee3-f7c1-4cab-a6bd-096baa684fca", "name": "network-vif-deleted", "tag": "4d99dc26-3a74-4c26-8fb0-ce3917c1284f"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:07:29.454816 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-3f94e971-1678-4b48-8c87-1d6b25c385a0 req-93a5aa03-ead9-43eb-8da6-b0d6f41b9559 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:29.455287 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-3f94e971-1678-4b48-8c87-1d6b25c385a0 req-93a5aa03-ead9-43eb-8da6-b0d6f41b9559 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:29.456036 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-3f94e971-1678-4b48-8c87-1d6b25c385a0 req-93a5aa03-ead9-43eb-8da6-b0d6f41b9559 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:29.472096 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-3f94e971-1678-4b48-8c87-1d6b25c385a0 req-93a5aa03-ead9-43eb-8da6-b0d6f41b9559 service nova] Creating event network-vif-deleted:4d99dc26-3a74-4c26-8fb0-ce3917c1284f for instance a6da2ee3-f7c1-4cab-a6bd-096baa684fca on hv-cinder-82099 Oct 11 12:07:29.480399 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-3f94e971-1678-4b48-8c87-1d6b25c385a0 req-93a5aa03-ead9-43eb-8da6-b0d6f41b9559 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039888 Oct 11 12:07:29.481461 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 317/644] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:07:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 12:07:30.293355 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-25d84bc8-c4b6-4561-917e-faae0fbc9183 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:30.294139 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-25d84bc8-c4b6-4561-917e-faae0fbc9183 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] [instance: a6da2ee3-f7c1-4cab-a6bd-096baa684fca] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:30.302957 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-25d84bc8-c4b6-4561-917e-faae0fbc9183 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:30.303584 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-25d84bc8-c4b6-4561-917e-faae0fbc9183 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:30.304325 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-25d84bc8-c4b6-4561-917e-faae0fbc9183 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:30.305402 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-25d84bc8-c4b6-4561-917e-faae0fbc9183 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:30.305938 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-25d84bc8-c4b6-4561-917e-faae0fbc9183 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:30.306415 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-25d84bc8-c4b6-4561-917e-faae0fbc9183 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:30.324078 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-25d84bc8-c4b6-4561-917e-faae0fbc9183 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] HTTP exception thrown: Instance a6da2ee3-f7c1-4cab-a6bd-096baa684fca could not be found. Oct 11 12:07:30.325683 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-25d84bc8-c4b6-4561-917e-faae0fbc9183 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Request method failure captured: Oct 11 12:07:30.325683 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca HTTP/1.1 Oct 11 12:07:30.325683 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 11 12:07:30.325683 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 11 12:07:30.325683 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Connection: close Oct 11 12:07:30.325683 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 11 12:07:30.325683 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 11 12:07:30.325683 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Host: 10.222.0.59 Oct 11 12:07:30.325683 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 11 12:07:30.325683 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 11 12:07:30.325683 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjRVrJaSzGAAsqN9YGFXD6DdIsLyt5xdpqMt74hKm0_jmhSi4ZXRo-fmMLSlB8g5keLfi_7ztQVJjqAgS19u6mD9NIFMQvvckksKoE6xupAQa0kDeitdjWA3oiAr9oO9Gi_CEanhcbJ1BGNm6XToopMs81aIIr4CbmeaUmYW-C9S4ctTo Oct 11 12:07:30.325683 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 11 12:07:30.325683 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 11 12:07:30.325683 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 11 12:07:30.325683 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 11 12:07:30.325683 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 11 12:07:30.325683 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 11 12:07:30.325683 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Id: e3e6a648f46646cea42b910d02e0628f Oct 11 12:07:30.325683 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-166493339 Oct 11 12:07:30.325683 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Role: reader,member Oct 11 12:07:30.325683 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Roles: reader,member Oct 11 12:07:30.327679 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e3e6a648f46646cea42b910d02e0628f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e3e6a648f46646cea42b910d02e0628f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e3e6a648f46646cea42b910d02e0628f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e3e6a648f46646cea42b910d02e0628f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:07:30.327679 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-ServerRescueNegativeTestJSON-166493339 Oct 11 12:07:30.327679 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Id: e3e6a648f46646cea42b910d02e0628f Oct 11 12:07:30.327679 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-166493339 Oct 11 12:07:30.327679 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User: tempest-ServerRescueNegativeTestJSON-166493339-project Oct 11 12:07:30.327679 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 11 12:07:30.327679 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 11 12:07:30.327679 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Id: c58107eee1b94541a330c26d7b82a53b Oct 11 12:07:30.327679 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-ServerRescueNegativeTestJSON-166493339-project Oct 11 12:07:30.327679 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: method: > Oct 11 12:07:30.327679 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: exception: Instance a6da2ee3-f7c1-4cab-a6bd-096baa684fca could not be found. Oct 11 12:07:30.327679 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: action_args: {'id': 'a6da2ee3-f7c1-4cab-a6bd-096baa684fca'} Oct 11 12:07:30.328799 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:07:30.328799 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:07:30.328799 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:07:30.328799 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:07:30.328799 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:07:30.328799 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:07:30.328799 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:07:30.328799 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:07:30.328799 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:07:30.328799 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:07:30.328799 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6da2ee3-f7c1-4cab-a6bd-096baa684fca could not be found. Oct 11 12:07:30.328799 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:07:30.328799 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:07:30.328799 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:07:30.328799 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:07:30.328799 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:07:30.328799 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:07:30.328799 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:07:30.328799 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:07:30.328799 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:07:30.330592 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:07:30.330592 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 12:07:30.330592 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 12:07:30.330592 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:07:30.330592 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:07:30.330592 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:07:30.330592 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:07:30.330592 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6da2ee3-f7c1-4cab-a6bd-096baa684fca could not be found. Oct 11 12:07:30.330592 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:07:30.330592 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:07:30.330592 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:07:30.330592 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:07:30.330592 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:07:30.330592 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:07:30.330592 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:07:30.330592 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:07:30.330592 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6da2ee3-f7c1-4cab-a6bd-096baa684fca could not be found. Oct 11 12:07:30.330592 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:07:30.333001 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-25d84bc8-c4b6-4561-917e-faae0fbc9183 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] Returning 404 to user: Instance a6da2ee3-f7c1-4cab-a6bd-096baa684fca could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:07:30.333001 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-25d84bc8-c4b6-4561-917e-faae0fbc9183 tempest-ServerRescueNegativeTestJSON-166493339 tempest-ServerRescueNegativeTestJSON-166493339-project] 10.222.0.59 "GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca" status: 404 len: 111 microversion: 2.1 time: 0.038577 Oct 11 12:07:30.333001 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 328/645] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:30 2022] GET /compute/v2.1/servers/a6da2ee3-f7c1-4cab-a6bd-096baa684fca => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:07:36.861511 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-49e4fb96-5639-4aa4-954a-2097ad9a2111 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1091876516", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1438686999", "security_groups": [{"name": "tempest-secgroup-smoke-27796490"}], "networks": [{"uuid": "978a1a77-3327-416b-871f-d7f71261595f"}], "block_device_mapping_v2": [{"uuid": "e9ca19e6-6040-4687-a6b5-b754a3b78551", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:07:36.882492 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=2 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:37.047611 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.network.neutron [None req-49e4fb96-5639-4aa4-954a-2097ad9a2111 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] validate_networks() for [('978a1a77-3327-416b-871f-d7f71261595f', None, None, None, None, None)] {{(pid=118994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 12:07:37.622073 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-49e4fb96-5639-4aa4-954a-2097ad9a2111 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Flavor limits 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 12:07:37.622488 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-49e4fb96-5639-4aa4-954a-2097ad9a2111 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Image limits 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 12:07:37.623003 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-49e4fb96-5639-4aa4-954a-2097ad9a2111 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Flavor pref 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 12:07:37.623401 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-49e4fb96-5639-4aa4-954a-2097ad9a2111 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Image pref 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 12:07:37.623868 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-49e4fb96-5639-4aa4-954a-2097ad9a2111 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 12:07:37.644966 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-49e4fb96-5639-4aa4-954a-2097ad9a2111 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:37.645913 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-49e4fb96-5639-4aa4-954a-2097ad9a2111 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:37.646793 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-49e4fb96-5639-4aa4-954a-2097ad9a2111 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:37.647815 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-49e4fb96-5639-4aa4-954a-2097ad9a2111 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:37.648567 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-49e4fb96-5639-4aa4-954a-2097ad9a2111 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:37.649206 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-49e4fb96-5639-4aa4-954a-2097ad9a2111 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:37.672576 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-49e4fb96-5639-4aa4-954a-2097ad9a2111 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Getting quotas for project ef7f8c1858da4f73925e63ea06100eab. Resources: {'ram', 'instances', 'cores'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 12:07:37.678097 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-49e4fb96-5639-4aa4-954a-2097ad9a2111 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Getting quotas for user edb722b67a804915bf38f34b67845bc9 and project ef7f8c1858da4f73925e63ea06100eab. Resources: {'ram', 'instances', 'cores'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 12:07:37.752095 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-49e4fb96-5639-4aa4-954a-2097ad9a2111 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Going to run 1 instances... {{(pid=118994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 12:07:37.754830 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-49e4fb96-5639-4aa4-954a-2097ad9a2111 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e9ca19e6-6040-4687-a6b5-b754a3b78551',volume_size=None,volume_type=None)] {{(pid=118994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 12:07:38.012173 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-49e4fb96-5639-4aa4-954a-2097ad9a2111 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.158608 Oct 11 12:07:38.013356 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 318/646] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Oct 11 12:07:36 2022] POST /compute/v2.1/servers => generated 404 bytes in 1162 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 12:07:38.030428 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6dd3a27d-4bce-4d5b-8904-8edd5d03f88f tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:38.032763 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-6dd3a27d-4bce-4d5b-8904-8edd5d03f88f tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:38.063075 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:38.176184 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6dd3a27d-4bce-4d5b-8904-8edd5d03f88f tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:38.200103 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6dd3a27d-4bce-4d5b-8904-8edd5d03f88f tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1089 microversion: 2.1 time: 0.173679 Oct 11 12:07:38.231824 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 329/647] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:38 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1089 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:07:39.256530 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-af0fbf6d-d0c4-483b-a1c0-b1820eb45503 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:39.258032 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-af0fbf6d-d0c4-483b-a1c0-b1820eb45503 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:39.267352 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-af0fbf6d-d0c4-483b-a1c0-b1820eb45503 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:39.267863 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-af0fbf6d-d0c4-483b-a1c0-b1820eb45503 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:39.268900 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-af0fbf6d-d0c4-483b-a1c0-b1820eb45503 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:39.270170 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-af0fbf6d-d0c4-483b-a1c0-b1820eb45503 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:39.270739 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-af0fbf6d-d0c4-483b-a1c0-b1820eb45503 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:39.271212 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-af0fbf6d-d0c4-483b-a1c0-b1820eb45503 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:39.353047 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-af0fbf6d-d0c4-483b-a1c0-b1820eb45503 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:39.363080 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-af0fbf6d-d0c4-483b-a1c0-b1820eb45503 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1187 microversion: 2.1 time: 0.111514 Oct 11 12:07:39.364294 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 319/648] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:39 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1187 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:07:40.404354 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-13ebc79e-8d99-4b48-af95-c51ed1b62194 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:40.405882 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-13ebc79e-8d99-4b48-af95-c51ed1b62194 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:40.421647 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=28 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:40.425760 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-13ebc79e-8d99-4b48-af95-c51ed1b62194 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:40.426725 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-13ebc79e-8d99-4b48-af95-c51ed1b62194 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:40.433167 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-13ebc79e-8d99-4b48-af95-c51ed1b62194 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:40.435030 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-13ebc79e-8d99-4b48-af95-c51ed1b62194 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:40.436681 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-13ebc79e-8d99-4b48-af95-c51ed1b62194 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:40.437456 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-13ebc79e-8d99-4b48-af95-c51ed1b62194 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:40.637285 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-13ebc79e-8d99-4b48-af95-c51ed1b62194 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:40.672463 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-13ebc79e-8d99-4b48-af95-c51ed1b62194 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1205 microversion: 2.1 time: 0.285496 Oct 11 12:07:40.676138 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 330/649] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:40 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1205 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:07:41.715311 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-50805c87-156c-43b2-ae66-46689d3742a4 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:41.718063 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-50805c87-156c-43b2-ae66-46689d3742a4 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:41.733913 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-50805c87-156c-43b2-ae66-46689d3742a4 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:41.735451 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-50805c87-156c-43b2-ae66-46689d3742a4 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:41.742025 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-50805c87-156c-43b2-ae66-46689d3742a4 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:41.744966 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-50805c87-156c-43b2-ae66-46689d3742a4 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:41.750747 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-50805c87-156c-43b2-ae66-46689d3742a4 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:41.752650 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-50805c87-156c-43b2-ae66-46689d3742a4 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:42.143614 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-50805c87-156c-43b2-ae66-46689d3742a4 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:42.162959 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-50805c87-156c-43b2-ae66-46689d3742a4 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1259 microversion: 2.1 time: 0.451738 Oct 11 12:07:42.165096 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 320/650] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:41 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1259 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:07:42.656528 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-b2da8c91-0a5d-4ebb-a232-3e3b93e07f7b req-e6fa720d-893c-46f9-a0b5-b8df4519a147 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ddb150d-886c-46f4-9c3d-0722148d7d91", "tag": "473109ef-4d1a-4e60-84ad-152e53b93a74"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:07:42.678473 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-b2da8c91-0a5d-4ebb-a232-3e3b93e07f7b req-e6fa720d-893c-46f9-a0b5-b8df4519a147 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:42.679407 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-b2da8c91-0a5d-4ebb-a232-3e3b93e07f7b req-e6fa720d-893c-46f9-a0b5-b8df4519a147 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:42.680580 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-b2da8c91-0a5d-4ebb-a232-3e3b93e07f7b req-e6fa720d-893c-46f9-a0b5-b8df4519a147 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:42.704479 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-b2da8c91-0a5d-4ebb-a232-3e3b93e07f7b req-e6fa720d-893c-46f9-a0b5-b8df4519a147 service nova] Creating event network-changed:473109ef-4d1a-4e60-84ad-152e53b93a74 for instance 5ddb150d-886c-46f4-9c3d-0722148d7d91 on hv-cinder-82099 Oct 11 12:07:42.722764 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-b2da8c91-0a5d-4ebb-a232-3e3b93e07f7b req-e6fa720d-893c-46f9-a0b5-b8df4519a147 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069957 Oct 11 12:07:42.726719 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 331/651] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 12:07:43.211711 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7581fb78-316e-4ba3-a196-78e7aefc7b24 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:43.212677 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7581fb78-316e-4ba3-a196-78e7aefc7b24 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:43.219738 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-878589b1-28ce-4542-b267-eb1d266a4597 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Action: 'create', calling method: .version_select at 0x7fd4067949d0>, body: {"keypair": {"name": "tempest-keypair-1876244646", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMxmP+EhLDcvOIafkB131OaSZWY1SyXTlPO+24Jxr7v1S74uM6ofCrEye7+uhvJtb0weGLiLBz5SoQHILXLsSUZIWLh47vM7ghVoaAYXtM+nW+XsTRaaD2+hR2Da6qM6ag=="}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:07:43.220574 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7581fb78-316e-4ba3-a196-78e7aefc7b24 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:43.221048 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7581fb78-316e-4ba3-a196-78e7aefc7b24 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:43.221588 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7581fb78-316e-4ba3-a196-78e7aefc7b24 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:43.222323 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7581fb78-316e-4ba3-a196-78e7aefc7b24 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:43.222963 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7581fb78-316e-4ba3-a196-78e7aefc7b24 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:43.223383 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7581fb78-316e-4ba3-a196-78e7aefc7b24 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:43.252030 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-878589b1-28ce-4542-b267-eb1d266a4597 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Getting quotas for project fee1ecae514e4c79a4f0fe601391971d. Resources: {'key_pairs'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 12:07:43.263526 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-878589b1-28ce-4542-b267-eb1d266a4597 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Getting quotas for user abfa19ab0a624de6ab082e8b1e57a220 and project fee1ecae514e4c79a4f0fe601391971d. Resources: {'key_pairs'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 12:07:43.302338 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-878589b1-28ce-4542-b267-eb1d266a4597 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.340935 Oct 11 12:07:43.304435 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 321/652] 10.222.0.59 () {62 vars in 1200 bytes} [Tue Oct 11 12:07:42 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 344 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 11 12:07:43.515242 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7581fb78-316e-4ba3-a196-78e7aefc7b24 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:43.525022 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7581fb78-316e-4ba3-a196-78e7aefc7b24 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1259 microversion: 2.1 time: 0.318711 Oct 11 12:07:43.526175 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 332/653] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:43 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1259 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:07:44.549375 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-f7632f11-adaf-4625-9c0b-d88eb9bd6649 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:44.550176 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-f7632f11-adaf-4625-9c0b-d88eb9bd6649 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:44.571479 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f7632f11-adaf-4625-9c0b-d88eb9bd6649 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:44.572872 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f7632f11-adaf-4625-9c0b-d88eb9bd6649 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:44.572872 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f7632f11-adaf-4625-9c0b-d88eb9bd6649 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:44.573146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f7632f11-adaf-4625-9c0b-d88eb9bd6649 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:44.581425 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f7632f11-adaf-4625-9c0b-d88eb9bd6649 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:44.581425 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f7632f11-adaf-4625-9c0b-d88eb9bd6649 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:44.852586 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-f7632f11-adaf-4625-9c0b-d88eb9bd6649 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:44.863141 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-f7632f11-adaf-4625-9c0b-d88eb9bd6649 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1259 microversion: 2.1 time: 0.317901 Oct 11 12:07:44.865344 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 322/654] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:44 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1259 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:07:44.981347 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-13ba7940-91b4-4268-b90f-805287f8f6f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1676517042", "imageRef": "09bcc8f8-a32f-4ec8-9ab2-a98964ad6a01", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed154ac0-1001-49f4-9212-ccb30c198992"}], "security_groups": [{"name": "tempest-securitygroup--1028521409"}], "key_name": "tempest-keypair-1876244646", "user_data": "}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:07:45.107552 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.network.neutron [None req-13ba7940-91b4-4268-b90f-805287f8f6f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] validate_networks() for [('ed154ac0-1001-49f4-9212-ccb30c198992', None, None, None, None, None)] {{(pid=118995) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 12:07:45.504235 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-13ba7940-91b4-4268-b90f-805287f8f6f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Flavor limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 12:07:45.504650 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-13ba7940-91b4-4268-b90f-805287f8f6f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Image limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 12:07:45.505147 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-13ba7940-91b4-4268-b90f-805287f8f6f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Flavor pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 12:07:45.505555 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-13ba7940-91b4-4268-b90f-805287f8f6f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Image pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 12:07:45.505958 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-13ba7940-91b4-4268-b90f-805287f8f6f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 12:07:45.515290 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-13ba7940-91b4-4268-b90f-805287f8f6f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:45.515775 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-13ba7940-91b4-4268-b90f-805287f8f6f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:45.516206 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-13ba7940-91b4-4268-b90f-805287f8f6f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:45.516929 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-13ba7940-91b4-4268-b90f-805287f8f6f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:45.517377 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-13ba7940-91b4-4268-b90f-805287f8f6f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:45.517802 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-13ba7940-91b4-4268-b90f-805287f8f6f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:45.536071 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-13ba7940-91b4-4268-b90f-805287f8f6f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Getting quotas for project fee1ecae514e4c79a4f0fe601391971d. Resources: {'ram', 'instances', 'cores'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 12:07:45.540274 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-13ba7940-91b4-4268-b90f-805287f8f6f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Getting quotas for user abfa19ab0a624de6ab082e8b1e57a220 and project fee1ecae514e4c79a4f0fe601391971d. Resources: {'ram', 'instances', 'cores'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 12:07:45.552964 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-13ba7940-91b4-4268-b90f-805287f8f6f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Going to run 1 instances... {{(pid=118995) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 12:07:45.555486 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-13ba7940-91b4-4268-b90f-805287f8f6f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09bcc8f8-a32f-4ec8-9ab2-a98964ad6a01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118995) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 12:07:45.609566 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-13ba7940-91b4-4268-b90f-805287f8f6f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.632756 Oct 11 12:07:45.610596 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 333/655] 10.222.0.59 () {62 vars in 1188 bytes} [Tue Oct 11 12:07:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 12:07:45.621879 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-285b2294-946b-4a59-a271-eb3d814c3704 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:45.622550 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-285b2294-946b-4a59-a271-eb3d814c3704 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:45.696009 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-285b2294-946b-4a59-a271-eb3d814c3704 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:45.707027 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-285b2294-946b-4a59-a271-eb3d814c3704 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:45.710900 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-285b2294-946b-4a59-a271-eb3d814c3704 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:45.712312 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-285b2294-946b-4a59-a271-eb3d814c3704 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1282 microversion: 2.20 time: 0.094503 Oct 11 12:07:45.732212 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 323/656] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:07:45 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1282 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:07:45.892731 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2d834126-5e4c-4517-909f-85af43f77bfa tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:45.893657 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2d834126-5e4c-4517-909f-85af43f77bfa tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:45.901928 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2d834126-5e4c-4517-909f-85af43f77bfa tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:45.902425 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2d834126-5e4c-4517-909f-85af43f77bfa tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:45.902967 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2d834126-5e4c-4517-909f-85af43f77bfa tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:45.903700 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2d834126-5e4c-4517-909f-85af43f77bfa tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:45.904163 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2d834126-5e4c-4517-909f-85af43f77bfa tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:45.904925 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2d834126-5e4c-4517-909f-85af43f77bfa tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:46.088909 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2d834126-5e4c-4517-909f-85af43f77bfa tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:46.112936 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2d834126-5e4c-4517-909f-85af43f77bfa tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1259 microversion: 2.1 time: 0.224975 Oct 11 12:07:46.113741 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 334/657] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:45 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1259 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:07:46.740364 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-99229546-b947-4676-aa02-52ad1ab51de7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:46.740961 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-99229546-b947-4676-aa02-52ad1ab51de7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:46.748599 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-99229546-b947-4676-aa02-52ad1ab51de7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:46.749249 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-99229546-b947-4676-aa02-52ad1ab51de7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:46.749707 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-99229546-b947-4676-aa02-52ad1ab51de7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:46.750418 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-99229546-b947-4676-aa02-52ad1ab51de7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:46.750958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-99229546-b947-4676-aa02-52ad1ab51de7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:46.751402 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-99229546-b947-4676-aa02-52ad1ab51de7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:46.820954 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-99229546-b947-4676-aa02-52ad1ab51de7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:46.830771 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-99229546-b947-4676-aa02-52ad1ab51de7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:46.832707 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-99229546-b947-4676-aa02-52ad1ab51de7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:46.833857 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-99229546-b947-4676-aa02-52ad1ab51de7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1334 microversion: 2.20 time: 0.097620 Oct 11 12:07:46.834428 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 324/658] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:07:46 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1334 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 12:07:47.140305 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ca2bed74-071d-4e74-adfb-0b81139db1b4 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:47.140935 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ca2bed74-071d-4e74-adfb-0b81139db1b4 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:47.148745 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ca2bed74-071d-4e74-adfb-0b81139db1b4 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:47.149331 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ca2bed74-071d-4e74-adfb-0b81139db1b4 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:47.149972 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ca2bed74-071d-4e74-adfb-0b81139db1b4 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:47.150965 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ca2bed74-071d-4e74-adfb-0b81139db1b4 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:47.151425 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ca2bed74-071d-4e74-adfb-0b81139db1b4 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:47.152147 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ca2bed74-071d-4e74-adfb-0b81139db1b4 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:47.385025 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ca2bed74-071d-4e74-adfb-0b81139db1b4 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:47.399893 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ca2bed74-071d-4e74-adfb-0b81139db1b4 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1259 microversion: 2.1 time: 0.263442 Oct 11 12:07:47.400891 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 335/659] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:47 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1259 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:07:47.859291 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-f5c3bf8b-3ce6-4a4c-90c0-b780e6e0189c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:47.860179 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-f5c3bf8b-3ce6-4a4c-90c0-b780e6e0189c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:47.862012 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell0:SELECT=2 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:47.869330 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f5c3bf8b-3ce6-4a4c-90c0-b780e6e0189c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:47.869819 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f5c3bf8b-3ce6-4a4c-90c0-b780e6e0189c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:47.870264 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f5c3bf8b-3ce6-4a4c-90c0-b780e6e0189c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:47.871021 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f5c3bf8b-3ce6-4a4c-90c0-b780e6e0189c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:47.871478 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f5c3bf8b-3ce6-4a4c-90c0-b780e6e0189c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:47.871894 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f5c3bf8b-3ce6-4a4c-90c0-b780e6e0189c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:48.226081 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-f5c3bf8b-3ce6-4a4c-90c0-b780e6e0189c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:48.235807 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-f5c3bf8b-3ce6-4a4c-90c0-b780e6e0189c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:48.237329 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-f5c3bf8b-3ce6-4a4c-90c0-b780e6e0189c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:48.240008 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-f5c3bf8b-3ce6-4a4c-90c0-b780e6e0189c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1340 microversion: 2.20 time: 0.384610 Oct 11 12:07:48.241033 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 325/660] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:07:47 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1340 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 12:07:48.431216 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-cc78fa05-b418-4955-aca6-33aa84e740ed tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:48.432241 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-cc78fa05-b418-4955-aca6-33aa84e740ed tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:48.438952 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cc78fa05-b418-4955-aca6-33aa84e740ed tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:48.439431 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cc78fa05-b418-4955-aca6-33aa84e740ed tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:48.440056 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cc78fa05-b418-4955-aca6-33aa84e740ed tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:48.441030 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cc78fa05-b418-4955-aca6-33aa84e740ed tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:48.441496 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cc78fa05-b418-4955-aca6-33aa84e740ed tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:48.441913 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cc78fa05-b418-4955-aca6-33aa84e740ed tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:48.676928 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-cc78fa05-b418-4955-aca6-33aa84e740ed tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:48.687157 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-cc78fa05-b418-4955-aca6-33aa84e740ed tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1259 microversion: 2.1 time: 0.261103 Oct 11 12:07:48.687726 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 336/661] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:48 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1259 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:07:49.006991 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-9e04b113-4be7-4805-ac93-a31c1bf0166b req-fa8021e6-e5d0-40a9-8e7f-1ab70d800f16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f1f910a-6135-426a-97a7-570948cf922c", "tag": "4781df9c-1cb1-4999-a0a2-4e1d4e77d276"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:07:49.017697 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-9e04b113-4be7-4805-ac93-a31c1bf0166b req-fa8021e6-e5d0-40a9-8e7f-1ab70d800f16 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:49.018944 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-9e04b113-4be7-4805-ac93-a31c1bf0166b req-fa8021e6-e5d0-40a9-8e7f-1ab70d800f16 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:49.019679 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-9e04b113-4be7-4805-ac93-a31c1bf0166b req-fa8021e6-e5d0-40a9-8e7f-1ab70d800f16 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:49.031797 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-9e04b113-4be7-4805-ac93-a31c1bf0166b req-fa8021e6-e5d0-40a9-8e7f-1ab70d800f16 service nova] Creating event network-changed:4781df9c-1cb1-4999-a0a2-4e1d4e77d276 for instance 2f1f910a-6135-426a-97a7-570948cf922c on hv-cinder-82099 Oct 11 12:07:49.037211 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-9e04b113-4be7-4805-ac93-a31c1bf0166b req-fa8021e6-e5d0-40a9-8e7f-1ab70d800f16 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034099 Oct 11 12:07:49.038079 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 326/662] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:07:49.275777 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f283d983-2ac9-440e-9133-6b5cdad1c6b0 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:49.276427 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f283d983-2ac9-440e-9133-6b5cdad1c6b0 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:49.284208 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f283d983-2ac9-440e-9133-6b5cdad1c6b0 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:49.284723 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f283d983-2ac9-440e-9133-6b5cdad1c6b0 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:49.285248 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f283d983-2ac9-440e-9133-6b5cdad1c6b0 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:49.286243 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f283d983-2ac9-440e-9133-6b5cdad1c6b0 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:49.286765 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f283d983-2ac9-440e-9133-6b5cdad1c6b0 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:49.287342 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f283d983-2ac9-440e-9133-6b5cdad1c6b0 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:49.487908 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f283d983-2ac9-440e-9133-6b5cdad1c6b0 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:49.496856 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f283d983-2ac9-440e-9133-6b5cdad1c6b0 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:49.498300 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f283d983-2ac9-440e-9133-6b5cdad1c6b0 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:49.499445 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f283d983-2ac9-440e-9133-6b5cdad1c6b0 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1408 microversion: 2.20 time: 0.233758 Oct 11 12:07:49.500015 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 337/663] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:07:49 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1408 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:07:49.712297 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-20b469b0-7392-47da-aa35-c9073eb2a350 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:49.712972 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-20b469b0-7392-47da-aa35-c9073eb2a350 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:49.720705 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-20b469b0-7392-47da-aa35-c9073eb2a350 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:49.721268 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-20b469b0-7392-47da-aa35-c9073eb2a350 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:49.721895 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-20b469b0-7392-47da-aa35-c9073eb2a350 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:49.722751 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-20b469b0-7392-47da-aa35-c9073eb2a350 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:49.723242 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-20b469b0-7392-47da-aa35-c9073eb2a350 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:49.723731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-20b469b0-7392-47da-aa35-c9073eb2a350 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:49.888953 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-20b469b0-7392-47da-aa35-c9073eb2a350 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:49.897990 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-20b469b0-7392-47da-aa35-c9073eb2a350 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1259 microversion: 2.1 time: 0.191051 Oct 11 12:07:49.898665 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 327/664] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:49 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1259 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:07:50.525224 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-166f5e2d-1839-4277-94c1-3b933df0a6a7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:50.525850 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-166f5e2d-1839-4277-94c1-3b933df0a6a7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:50.533082 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-166f5e2d-1839-4277-94c1-3b933df0a6a7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:50.533561 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-166f5e2d-1839-4277-94c1-3b933df0a6a7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:50.533998 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-166f5e2d-1839-4277-94c1-3b933df0a6a7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:50.534718 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-166f5e2d-1839-4277-94c1-3b933df0a6a7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:50.535168 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-166f5e2d-1839-4277-94c1-3b933df0a6a7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:50.535586 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-166f5e2d-1839-4277-94c1-3b933df0a6a7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:50.684626 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-166f5e2d-1839-4277-94c1-3b933df0a6a7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:50.694004 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-166f5e2d-1839-4277-94c1-3b933df0a6a7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:50.695496 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-166f5e2d-1839-4277-94c1-3b933df0a6a7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:50.696617 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-166f5e2d-1839-4277-94c1-3b933df0a6a7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1408 microversion: 2.20 time: 0.175692 Oct 11 12:07:50.697192 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 338/665] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:07:50 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1408 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:07:50.925746 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-f7fa99c6-998b-4658-8787-b0c6b5d44b97 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:50.926868 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-f7fa99c6-998b-4658-8787-b0c6b5d44b97 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:50.934767 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f7fa99c6-998b-4658-8787-b0c6b5d44b97 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:50.935259 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f7fa99c6-998b-4658-8787-b0c6b5d44b97 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:50.935715 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f7fa99c6-998b-4658-8787-b0c6b5d44b97 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:50.936527 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f7fa99c6-998b-4658-8787-b0c6b5d44b97 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:50.937016 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f7fa99c6-998b-4658-8787-b0c6b5d44b97 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:50.937433 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f7fa99c6-998b-4658-8787-b0c6b5d44b97 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:51.106838 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-f7fa99c6-998b-4658-8787-b0c6b5d44b97 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:51.117619 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-f7fa99c6-998b-4658-8787-b0c6b5d44b97 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1259 microversion: 2.1 time: 0.197478 Oct 11 12:07:51.118102 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 328/666] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:50 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1259 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:07:51.722170 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-19e505da-000c-42e5-9c65-806fd8b052c7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:51.722868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-19e505da-000c-42e5-9c65-806fd8b052c7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:51.732206 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-19e505da-000c-42e5-9c65-806fd8b052c7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:51.733058 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-19e505da-000c-42e5-9c65-806fd8b052c7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:51.733790 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-19e505da-000c-42e5-9c65-806fd8b052c7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:51.735095 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-19e505da-000c-42e5-9c65-806fd8b052c7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:51.735906 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-19e505da-000c-42e5-9c65-806fd8b052c7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:51.736649 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-19e505da-000c-42e5-9c65-806fd8b052c7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:51.892380 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-19e505da-000c-42e5-9c65-806fd8b052c7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:51.908387 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-19e505da-000c-42e5-9c65-806fd8b052c7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:51.911416 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-19e505da-000c-42e5-9c65-806fd8b052c7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:51.913609 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-19e505da-000c-42e5-9c65-806fd8b052c7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1408 microversion: 2.20 time: 0.195348 Oct 11 12:07:51.914882 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 339/667] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:07:51 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1408 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:07:52.148754 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-8adf6d2c-fcff-4f73-b2d0-ee949587e7d0 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:52.149577 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-8adf6d2c-fcff-4f73-b2d0-ee949587e7d0 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:52.157299 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8adf6d2c-fcff-4f73-b2d0-ee949587e7d0 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:52.157823 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8adf6d2c-fcff-4f73-b2d0-ee949587e7d0 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:52.158289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8adf6d2c-fcff-4f73-b2d0-ee949587e7d0 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:52.159164 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8adf6d2c-fcff-4f73-b2d0-ee949587e7d0 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:52.160694 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8adf6d2c-fcff-4f73-b2d0-ee949587e7d0 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:52.161343 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8adf6d2c-fcff-4f73-b2d0-ee949587e7d0 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:52.309917 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-8adf6d2c-fcff-4f73-b2d0-ee949587e7d0 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:52.319777 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-8adf6d2c-fcff-4f73-b2d0-ee949587e7d0 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1259 microversion: 2.1 time: 0.175153 Oct 11 12:07:52.320386 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 329/668] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:52 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1259 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:07:52.950080 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0a09bbf9-95e7-4c8b-ae48-a68b5b59c20a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:52.950695 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0a09bbf9-95e7-4c8b-ae48-a68b5b59c20a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:52.957704 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0a09bbf9-95e7-4c8b-ae48-a68b5b59c20a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:52.958171 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0a09bbf9-95e7-4c8b-ae48-a68b5b59c20a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:52.958669 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0a09bbf9-95e7-4c8b-ae48-a68b5b59c20a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:52.959422 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0a09bbf9-95e7-4c8b-ae48-a68b5b59c20a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:52.959869 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0a09bbf9-95e7-4c8b-ae48-a68b5b59c20a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:52.960326 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0a09bbf9-95e7-4c8b-ae48-a68b5b59c20a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:53.191237 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0a09bbf9-95e7-4c8b-ae48-a68b5b59c20a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:53.201600 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0a09bbf9-95e7-4c8b-ae48-a68b5b59c20a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:53.203222 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0a09bbf9-95e7-4c8b-ae48-a68b5b59c20a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:53.204258 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0a09bbf9-95e7-4c8b-ae48-a68b5b59c20a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1408 microversion: 2.20 time: 0.258317 Oct 11 12:07:53.204774 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 340/669] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:07:52 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1408 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:07:53.327404 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-e15682b2-77bc-4b46-ad89-914ef81d7235 req-2bd5278a-4e7d-4553-950b-60d89379aae7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ddb150d-886c-46f4-9c3d-0722148d7d91", "name": "network-vif-plugged", "status": "completed", "tag": "473109ef-4d1a-4e60-84ad-152e53b93a74"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:07:53.346596 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-e15682b2-77bc-4b46-ad89-914ef81d7235 req-2bd5278a-4e7d-4553-950b-60d89379aae7 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:53.347816 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-e15682b2-77bc-4b46-ad89-914ef81d7235 req-2bd5278a-4e7d-4553-950b-60d89379aae7 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:53.348730 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-e15682b2-77bc-4b46-ad89-914ef81d7235 req-2bd5278a-4e7d-4553-950b-60d89379aae7 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:53.356204 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:53.357708 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7955c6a9-8ca6-4616-87cd-ebed0b988bcd tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:53.359225 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7955c6a9-8ca6-4616-87cd-ebed0b988bcd tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:53.369506 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7955c6a9-8ca6-4616-87cd-ebed0b988bcd tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:53.370720 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7955c6a9-8ca6-4616-87cd-ebed0b988bcd tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:53.371548 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7955c6a9-8ca6-4616-87cd-ebed0b988bcd tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:53.372908 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7955c6a9-8ca6-4616-87cd-ebed0b988bcd tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:53.373581 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-e15682b2-77bc-4b46-ad89-914ef81d7235 req-2bd5278a-4e7d-4553-950b-60d89379aae7 service nova] Creating event network-vif-plugged:473109ef-4d1a-4e60-84ad-152e53b93a74 for instance 5ddb150d-886c-46f4-9c3d-0722148d7d91 on hv-cinder-82099 Oct 11 12:07:53.373758 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7955c6a9-8ca6-4616-87cd-ebed0b988bcd tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:53.374524 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7955c6a9-8ca6-4616-87cd-ebed0b988bcd tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:53.382834 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-e15682b2-77bc-4b46-ad89-914ef81d7235 req-2bd5278a-4e7d-4553-950b-60d89379aae7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062864 Oct 11 12:07:53.384884 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 330/670] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:07:53.562505 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7955c6a9-8ca6-4616-87cd-ebed0b988bcd tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:53.571030 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7955c6a9-8ca6-4616-87cd-ebed0b988bcd tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1259 microversion: 2.1 time: 0.226240 Oct 11 12:07:53.571624 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 341/671] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:53 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1259 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:07:54.229982 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-50d9cb19-42bb-4355-a7fd-45f5253c0a20 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:54.230713 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-50d9cb19-42bb-4355-a7fd-45f5253c0a20 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:54.238544 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-50d9cb19-42bb-4355-a7fd-45f5253c0a20 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:54.239181 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-50d9cb19-42bb-4355-a7fd-45f5253c0a20 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:54.239652 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-50d9cb19-42bb-4355-a7fd-45f5253c0a20 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:54.240358 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-50d9cb19-42bb-4355-a7fd-45f5253c0a20 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:54.241017 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-50d9cb19-42bb-4355-a7fd-45f5253c0a20 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:54.241465 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-50d9cb19-42bb-4355-a7fd-45f5253c0a20 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:54.387760 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-50d9cb19-42bb-4355-a7fd-45f5253c0a20 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:54.399405 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-50d9cb19-42bb-4355-a7fd-45f5253c0a20 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:54.400856 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-50d9cb19-42bb-4355-a7fd-45f5253c0a20 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:54.402000 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-50d9cb19-42bb-4355-a7fd-45f5253c0a20 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1408 microversion: 2.20 time: 0.176597 Oct 11 12:07:54.402617 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 331/672] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:07:54 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 12:07:54.594715 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7213e0e7-8e4b-42ec-8b53-337a24411346 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:54.595362 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7213e0e7-8e4b-42ec-8b53-337a24411346 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:54.602593 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7213e0e7-8e4b-42ec-8b53-337a24411346 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:54.603092 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7213e0e7-8e4b-42ec-8b53-337a24411346 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:54.603606 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7213e0e7-8e4b-42ec-8b53-337a24411346 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:54.604304 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7213e0e7-8e4b-42ec-8b53-337a24411346 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:54.604742 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7213e0e7-8e4b-42ec-8b53-337a24411346 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:54.605157 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7213e0e7-8e4b-42ec-8b53-337a24411346 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:54.758088 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7213e0e7-8e4b-42ec-8b53-337a24411346 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:54.770080 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7213e0e7-8e4b-42ec-8b53-337a24411346 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1259 microversion: 2.1 time: 0.179039 Oct 11 12:07:54.770784 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 342/673] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:54 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:07:55.404062 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-45411369-4bdf-4898-b6a5-1e51deaa48e8 req-60c0dcc0-1e60-4f05-a519-432431483687 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f1f910a-6135-426a-97a7-570948cf922c", "name": "network-vif-plugged", "status": "completed", "tag": "4781df9c-1cb1-4999-a0a2-4e1d4e77d276"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:07:55.414600 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-45411369-4bdf-4898-b6a5-1e51deaa48e8 req-60c0dcc0-1e60-4f05-a519-432431483687 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:55.415103 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-45411369-4bdf-4898-b6a5-1e51deaa48e8 req-60c0dcc0-1e60-4f05-a519-432431483687 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:55.415531 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-45411369-4bdf-4898-b6a5-1e51deaa48e8 req-60c0dcc0-1e60-4f05-a519-432431483687 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:55.427847 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-464ef8ba-1117-4dd1-ba33-86fa0fc9de30 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:55.428454 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-464ef8ba-1117-4dd1-ba33-86fa0fc9de30 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:55.429558 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-45411369-4bdf-4898-b6a5-1e51deaa48e8 req-60c0dcc0-1e60-4f05-a519-432431483687 service nova] Creating event network-vif-plugged:4781df9c-1cb1-4999-a0a2-4e1d4e77d276 for instance 2f1f910a-6135-426a-97a7-570948cf922c on hv-cinder-82099 Oct 11 12:07:55.435999 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-464ef8ba-1117-4dd1-ba33-86fa0fc9de30 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:55.436204 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-45411369-4bdf-4898-b6a5-1e51deaa48e8 req-60c0dcc0-1e60-4f05-a519-432431483687 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035185 Oct 11 12:07:55.436358 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-464ef8ba-1117-4dd1-ba33-86fa0fc9de30 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:55.436358 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-464ef8ba-1117-4dd1-ba33-86fa0fc9de30 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:55.436635 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 332/674] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:07:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:07:55.436787 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-464ef8ba-1117-4dd1-ba33-86fa0fc9de30 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:55.437230 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-464ef8ba-1117-4dd1-ba33-86fa0fc9de30 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:55.437654 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-464ef8ba-1117-4dd1-ba33-86fa0fc9de30 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:55.525176 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=2 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:55.547849 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=8 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:55.590326 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-464ef8ba-1117-4dd1-ba33-86fa0fc9de30 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:55.602726 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-464ef8ba-1117-4dd1-ba33-86fa0fc9de30 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:55.604814 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-464ef8ba-1117-4dd1-ba33-86fa0fc9de30 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:55.606745 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-464ef8ba-1117-4dd1-ba33-86fa0fc9de30 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1408 microversion: 2.20 time: 0.182731 Oct 11 12:07:55.607720 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 343/675] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:07:55 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1408 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:07:55.789971 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell0:SELECT=12 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:07:55.794095 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-a92857a2-6bf1-4489-8e42-4345ec37f030 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:55.794828 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-a92857a2-6bf1-4489-8e42-4345ec37f030 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:55.801602 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a92857a2-6bf1-4489-8e42-4345ec37f030 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:55.802085 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a92857a2-6bf1-4489-8e42-4345ec37f030 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:55.802507 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a92857a2-6bf1-4489-8e42-4345ec37f030 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:55.803248 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a92857a2-6bf1-4489-8e42-4345ec37f030 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:55.803746 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a92857a2-6bf1-4489-8e42-4345ec37f030 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:55.804161 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a92857a2-6bf1-4489-8e42-4345ec37f030 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:55.958731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-a92857a2-6bf1-4489-8e42-4345ec37f030 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:55.968336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-a92857a2-6bf1-4489-8e42-4345ec37f030 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1259 microversion: 2.1 time: 0.179370 Oct 11 12:07:55.968922 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 333/676] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:55 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1259 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:07:56.636468 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6d31c683-879a-4c7b-8022-5580e44bfbea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:56.637326 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-6d31c683-879a-4c7b-8022-5580e44bfbea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:56.648083 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6d31c683-879a-4c7b-8022-5580e44bfbea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:56.648828 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6d31c683-879a-4c7b-8022-5580e44bfbea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:56.649600 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6d31c683-879a-4c7b-8022-5580e44bfbea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:56.650874 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6d31c683-879a-4c7b-8022-5580e44bfbea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:56.651699 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6d31c683-879a-4c7b-8022-5580e44bfbea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:56.652432 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6d31c683-879a-4c7b-8022-5580e44bfbea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:56.830500 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6d31c683-879a-4c7b-8022-5580e44bfbea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:56.839778 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6d31c683-879a-4c7b-8022-5580e44bfbea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:56.841222 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6d31c683-879a-4c7b-8022-5580e44bfbea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:56.842360 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6d31c683-879a-4c7b-8022-5580e44bfbea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1408 microversion: 2.20 time: 0.209946 Oct 11 12:07:56.842992 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 344/677] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:07:56 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1408 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:07:56.992157 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-fa77d384-365b-4f57-a1c6-b5c871f487b5 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:56.992799 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-fa77d384-365b-4f57-a1c6-b5c871f487b5 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:56.999930 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-fa77d384-365b-4f57-a1c6-b5c871f487b5 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:57.000417 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-fa77d384-365b-4f57-a1c6-b5c871f487b5 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:57.000845 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-fa77d384-365b-4f57-a1c6-b5c871f487b5 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:57.001534 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-fa77d384-365b-4f57-a1c6-b5c871f487b5 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:57.001977 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-fa77d384-365b-4f57-a1c6-b5c871f487b5 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:57.002388 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-fa77d384-365b-4f57-a1c6-b5c871f487b5 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:57.147085 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-fa77d384-365b-4f57-a1c6-b5c871f487b5 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:57.155213 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-fa77d384-365b-4f57-a1c6-b5c871f487b5 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1443 microversion: 2.1 time: 0.167129 Oct 11 12:07:57.155788 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 334/678] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:56 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1443 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:07:57.178103 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5da9ee58-7408-43a0-a8e7-cc7d4affff06 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:57.178775 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-5da9ee58-7408-43a0-a8e7-cc7d4affff06 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:57.185503 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5da9ee58-7408-43a0-a8e7-cc7d4affff06 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:57.185987 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5da9ee58-7408-43a0-a8e7-cc7d4affff06 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:57.186422 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5da9ee58-7408-43a0-a8e7-cc7d4affff06 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:57.187170 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5da9ee58-7408-43a0-a8e7-cc7d4affff06 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:57.187623 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5da9ee58-7408-43a0-a8e7-cc7d4affff06 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:57.188048 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5da9ee58-7408-43a0-a8e7-cc7d4affff06 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:57.329908 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5da9ee58-7408-43a0-a8e7-cc7d4affff06 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:57.338012 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5da9ee58-7408-43a0-a8e7-cc7d4affff06 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1443 microversion: 2.1 time: 0.164046 Oct 11 12:07:57.338585 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 345/679] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:07:57 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1443 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:07:57.867995 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-8b83f759-cf47-489b-921f-ef3893638922 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:57.868594 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-8b83f759-cf47-489b-921f-ef3893638922 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:57.875566 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8b83f759-cf47-489b-921f-ef3893638922 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:57.876068 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8b83f759-cf47-489b-921f-ef3893638922 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:57.876501 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8b83f759-cf47-489b-921f-ef3893638922 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:57.877214 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8b83f759-cf47-489b-921f-ef3893638922 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:57.877654 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8b83f759-cf47-489b-921f-ef3893638922 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:57.878302 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8b83f759-cf47-489b-921f-ef3893638922 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:58.135471 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-8b83f759-cf47-489b-921f-ef3893638922 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:58.155011 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-8b83f759-cf47-489b-921f-ef3893638922 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:58.163134 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-8b83f759-cf47-489b-921f-ef3893638922 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:07:58.165917 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-8b83f759-cf47-489b-921f-ef3893638922 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1601 microversion: 2.20 time: 0.301746 Oct 11 12:07:58.191404 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 335/680] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:07:57 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1601 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:07:58.215429 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e0c8ee79-8765-49cf-99ef-b087a45c7a8b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:58.216302 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e0c8ee79-8765-49cf-99ef-b087a45c7a8b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:58.228138 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e0c8ee79-8765-49cf-99ef-b087a45c7a8b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:58.229003 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e0c8ee79-8765-49cf-99ef-b087a45c7a8b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:58.229767 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e0c8ee79-8765-49cf-99ef-b087a45c7a8b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:58.231016 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e0c8ee79-8765-49cf-99ef-b087a45c7a8b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:58.231830 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e0c8ee79-8765-49cf-99ef-b087a45c7a8b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:58.232581 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e0c8ee79-8765-49cf-99ef-b087a45c7a8b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:58.319091 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e0c8ee79-8765-49cf-99ef-b087a45c7a8b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.112084 Oct 11 12:07:58.319799 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 346/681] 10.222.0.59 () {60 vars in 1316 bytes} [Tue Oct 11 12:07:58 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-interface => generated 285 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 12:07:59.021453 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-703413c5-332a-4b54-bcfa-b392ff264bf1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:07:59.021922 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-703413c5-332a-4b54-bcfa-b392ff264bf1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: c568e704-7d29-4312-957d-35ed16806e9e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:07:59.029652 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-703413c5-332a-4b54-bcfa-b392ff264bf1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:59.030132 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-703413c5-332a-4b54-bcfa-b392ff264bf1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:59.030852 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-703413c5-332a-4b54-bcfa-b392ff264bf1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:59.031806 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-703413c5-332a-4b54-bcfa-b392ff264bf1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:59.032429 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-703413c5-332a-4b54-bcfa-b392ff264bf1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:59.033031 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-703413c5-332a-4b54-bcfa-b392ff264bf1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:59.060303 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-703413c5-332a-4b54-bcfa-b392ff264bf1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e/ips" status: 200 len: 150 microversion: 2.1 time: 0.042981 Oct 11 12:07:59.060675 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 336/682] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Oct 11 12:07:59 2022] GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e/ips => generated 150 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:07:59.697366 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-c12ea344-7d33-4d08-a8c8-72c304be48e6 req-4dc6ce7a-3c94-4d94-91f0-85b1d15723f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f1f910a-6135-426a-97a7-570948cf922c", "tag": "4781df9c-1cb1-4999-a0a2-4e1d4e77d276"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:07:59.752710 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-c12ea344-7d33-4d08-a8c8-72c304be48e6 req-4dc6ce7a-3c94-4d94-91f0-85b1d15723f4 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:07:59.753647 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-c12ea344-7d33-4d08-a8c8-72c304be48e6 req-4dc6ce7a-3c94-4d94-91f0-85b1d15723f4 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:07:59.754408 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-c12ea344-7d33-4d08-a8c8-72c304be48e6 req-4dc6ce7a-3c94-4d94-91f0-85b1d15723f4 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:07:59.787236 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-c12ea344-7d33-4d08-a8c8-72c304be48e6 req-4dc6ce7a-3c94-4d94-91f0-85b1d15723f4 service nova] Creating event network-changed:4781df9c-1cb1-4999-a0a2-4e1d4e77d276 for instance 2f1f910a-6135-426a-97a7-570948cf922c on hv-cinder-82099 Oct 11 12:07:59.798971 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-c12ea344-7d33-4d08-a8c8-72c304be48e6 req-4dc6ce7a-3c94-4d94-91f0-85b1d15723f4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108500 Oct 11 12:07:59.802709 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 347/683] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:08:00.020362 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-1e3e8fc9-fdaa-47df-b9e6-fb923ca9fd8c req-2be42197-76eb-4b2d-83ba-1d24ea5b2b2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ddb150d-886c-46f4-9c3d-0722148d7d91", "tag": "473109ef-4d1a-4e60-84ad-152e53b93a74"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:08:00.034151 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-1e3e8fc9-fdaa-47df-b9e6-fb923ca9fd8c req-2be42197-76eb-4b2d-83ba-1d24ea5b2b2e service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:00.035108 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-1e3e8fc9-fdaa-47df-b9e6-fb923ca9fd8c req-2be42197-76eb-4b2d-83ba-1d24ea5b2b2e service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:00.035729 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-1e3e8fc9-fdaa-47df-b9e6-fb923ca9fd8c req-2be42197-76eb-4b2d-83ba-1d24ea5b2b2e service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:00.050002 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-1e3e8fc9-fdaa-47df-b9e6-fb923ca9fd8c req-2be42197-76eb-4b2d-83ba-1d24ea5b2b2e service nova] Creating event network-changed:473109ef-4d1a-4e60-84ad-152e53b93a74 for instance 5ddb150d-886c-46f4-9c3d-0722148d7d91 on hv-cinder-82099 Oct 11 12:08:00.055804 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-1e3e8fc9-fdaa-47df-b9e6-fb923ca9fd8c req-2be42197-76eb-4b2d-83ba-1d24ea5b2b2e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.222412 Oct 11 12:08:00.061044 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 337/684] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:07:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:08:00.713714 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-41ea14f4-ed5f-484b-96f1-899938c50431 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4fd3aa88-3698-4cba-840a-6b9dd08ff1d6"}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:08:00.716325 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-41ea14f4-ed5f-484b-96f1-899938c50431 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: c568e704-7d29-4312-957d-35ed16806e9e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:00.725251 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-41ea14f4-ed5f-484b-96f1-899938c50431 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:00.726020 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-41ea14f4-ed5f-484b-96f1-899938c50431 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:00.726633 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-41ea14f4-ed5f-484b-96f1-899938c50431 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:00.727555 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-41ea14f4-ed5f-484b-96f1-899938c50431 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:00.728373 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-41ea14f4-ed5f-484b-96f1-899938c50431 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:00.728808 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-41ea14f4-ed5f-484b-96f1-899938c50431 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:00.836076 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=100 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:01.124328 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-41ea14f4-ed5f-484b-96f1-899938c50431 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "POST /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.414340 Oct 11 12:08:01.136232 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 348/685] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Oct 11 12:08:00 2022] POST /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e/os-volume_attachments => generated 194 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 12:08:08.805395 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-3a4c4792-d2cb-4abb-bcc7-41c8632ab243 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4fd3aa88-3698-4cba-840a-6b9dd08ff1d6"}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:08:08.807850 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-3a4c4792-d2cb-4abb-bcc7-41c8632ab243 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: c568e704-7d29-4312-957d-35ed16806e9e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:08.809891 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=4 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:08.816579 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3a4c4792-d2cb-4abb-bcc7-41c8632ab243 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:08.817114 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3a4c4792-d2cb-4abb-bcc7-41c8632ab243 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:08.817582 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3a4c4792-d2cb-4abb-bcc7-41c8632ab243 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:08.818425 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3a4c4792-d2cb-4abb-bcc7-41c8632ab243 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:08.818922 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3a4c4792-d2cb-4abb-bcc7-41c8632ab243 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:08.819289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3a4c4792-d2cb-4abb-bcc7-41c8632ab243 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:08.922004 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.wsgi [None req-3a4c4792-d2cb-4abb-bcc7-41c8632ab243 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] HTTP exception thrown: Invalid volume: volume 4fd3aa88-3698-4cba-840a-6b9dd08ff1d6 is already attached to instances: c568e704-7d29-4312-957d-35ed16806e9e Oct 11 12:08:08.925041 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-3a4c4792-d2cb-4abb-bcc7-41c8632ab243 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Request method failure captured: Oct 11 12:08:08.925041 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: request: POST /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e/os-volume_attachments HTTP/1.1 Oct 11 12:08:08.925041 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept: application/json Oct 11 12:08:08.925041 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept-Encoding: identity Oct 11 12:08:08.925041 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Connection: close Oct 11 12:08:08.925041 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Length: 74 Oct 11 12:08:08.925041 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Type: application/json Oct 11 12:08:08.925041 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Host: 10.222.0.59 Oct 11 12:08:08.925041 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Openstack-System-Scope: None Oct 11 12:08:08.925041 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: User-Agent: python-urllib3/1.26.12 Oct 11 12:08:08.925041 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Auth-Token: gAAAAABjRVrDbBzKTyV9eZUXZryLVe-KpT4WYEHJaER5TFyRAvTSEg5lw7FxKmfGi17rpAnxooOQ2r63AULbLGHHY4hm760kGTTUbeHuyR9-shGVTsiYjly6leZlsPXT8VYCrZ-E0QA-DYApJOgvSEAYz3JHEXcb3Qg12yFjALYOMVuEZNDDhBk Oct 11 12:08:08.925041 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Id: None Oct 11 12:08:08.925041 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Name: None Oct 11 12:08:08.925041 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Identity-Status: Confirmed Oct 11 12:08:08.925041 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Is-Admin-Project: True Oct 11 12:08:08.925041 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Id: default Oct 11 12:08:08.925041 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Name: Default Oct 11 12:08:08.925041 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Id: c83f971a0ae04288a5c6dc87d3370979 Oct 11 12:08:08.925041 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Name: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:08:08.925041 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Role: reader,member Oct 11 12:08:08.925041 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Roles: reader,member Oct 11 12:08:08.926731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:08:08.926731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:08:08.926731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Id: c83f971a0ae04288a5c6dc87d3370979 Oct 11 12:08:08.926731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:08:08.926731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User: tempest-AttachVolumeNegativeTest-1543839758-project Oct 11 12:08:08.926731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Id: default Oct 11 12:08:08.926731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Name: Default Oct 11 12:08:08.926731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Id: 41d3680dda7c4cc8aeb6d086efca0775 Oct 11 12:08:08.926731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Name: tempest-AttachVolumeNegativeTest-1543839758-project Oct 11 12:08:08.926731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Oct 11 12:08:08.926731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: {"volumeAttachment": {"volumeId": "4fd3aa88-3698-4cba-840a-6b9dd08ff1d6"}} Oct 11 12:08:08.926731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: method: > Oct 11 12:08:08.929428 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: exception: Invalid volume: volume 4fd3aa88-3698-4cba-840a-6b9dd08ff1d6 is already attached to instances: c568e704-7d29-4312-957d-35ed16806e9e Oct 11 12:08:08.929428 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: action_args: {'server_id': 'c568e704-7d29-4312-957d-35ed16806e9e', 'body': {'volumeAttachment': {'volumeId': '4fd3aa88-3698-4cba-840a-6b9dd08ff1d6'}}} Oct 11 12:08:08.929428 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:08:08.929428 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:08:08.929428 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 11 12:08:08.929428 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 11 12:08:08.929428 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 12:08:08.929428 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 12:08:08.929428 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 11 12:08:08.929428 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 12:08:08.929428 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 11 12:08:08.929428 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 11 12:08:08.929428 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 11 12:08:08.929428 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 11 12:08:08.929428 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 4fd3aa88-3698-4cba-840a-6b9dd08ff1d6 is already attached to instances: c568e704-7d29-4312-957d-35ed16806e9e Oct 11 12:08:08.929428 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:08:08.929428 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:08:08.929428 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:08:08.929428 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:08:08.930851 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:08:08.930851 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:08:08.930851 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:08:08.930851 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:08:08.930851 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:08:08.930851 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:08:08.930851 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 12:08:08.930851 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 12:08:08.930851 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 12:08:08.930851 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 12:08:08.930851 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 12:08:08.930851 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 12:08:08.930851 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 11 12:08:08.930851 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 11 12:08:08.930851 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 4fd3aa88-3698-4cba-840a-6b9dd08ff1d6 is already attached to instances: c568e704-7d29-4312-957d-35ed16806e9e Oct 11 12:08:08.930851 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:08:08.930851 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:08:08.930851 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:08:08.930851 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:08:08.930851 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:08:08.932184 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:08:08.932184 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:08:08.932184 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:08:08.932184 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 4fd3aa88-3698-4cba-840a-6b9dd08ff1d6 is already attached to instances: c568e704-7d29-4312-957d-35ed16806e9e Oct 11 12:08:08.932184 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:08:08.932184 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-3a4c4792-d2cb-4abb-bcc7-41c8632ab243 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Returning 400 to user: Invalid volume: volume 4fd3aa88-3698-4cba-840a-6b9dd08ff1d6 is already attached to instances: c568e704-7d29-4312-957d-35ed16806e9e {{(pid=118994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:08:08.932184 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-3a4c4792-d2cb-4abb-bcc7-41c8632ab243 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "POST /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.126571 Oct 11 12:08:08.932184 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 338/686] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Oct 11 12:08:08 2022] POST /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e/os-volume_attachments => generated 174 bytes in 128 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 12:08:08.998467 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-40733500-f541-40bc-a1d9-897c9bdba97d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:08.999116 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-40733500-f541-40bc-a1d9-897c9bdba97d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: c568e704-7d29-4312-957d-35ed16806e9e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:09.001783 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:09.008216 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-40733500-f541-40bc-a1d9-897c9bdba97d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:09.008730 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-40733500-f541-40bc-a1d9-897c9bdba97d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:09.009140 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-40733500-f541-40bc-a1d9-897c9bdba97d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:09.009834 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-40733500-f541-40bc-a1d9-897c9bdba97d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:09.010278 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-40733500-f541-40bc-a1d9-897c9bdba97d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:09.010724 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-40733500-f541-40bc-a1d9-897c9bdba97d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:09.099493 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-40733500-f541-40bc-a1d9-897c9bdba97d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lazy-loading 'services' on Instance uuid c568e704-7d29-4312-957d-35ed16806e9e {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:08:09.182441 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-40733500-f541-40bc-a1d9-897c9bdba97d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e/os-volume_attachments/4fd3aa88-3698-4cba-840a-6b9dd08ff1d6" status: 202 len: 0 microversion: 2.1 time: 0.188072 Oct 11 12:08:09.182986 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 349/687] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Oct 11 12:08:08 2022] DELETE /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e/os-volume_attachments/4fd3aa88-3698-4cba-840a-6b9dd08ff1d6 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 12:08:09.191648 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-0874773f-ea62-4cec-a0d9-12a8658f5dda tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:09.193862 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-0874773f-ea62-4cec-a0d9-12a8658f5dda tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: c568e704-7d29-4312-957d-35ed16806e9e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:09.201255 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0874773f-ea62-4cec-a0d9-12a8658f5dda tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:09.201747 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0874773f-ea62-4cec-a0d9-12a8658f5dda tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:09.202255 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0874773f-ea62-4cec-a0d9-12a8658f5dda tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:09.202983 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0874773f-ea62-4cec-a0d9-12a8658f5dda tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:09.203449 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0874773f-ea62-4cec-a0d9-12a8658f5dda tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:09.203854 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0874773f-ea62-4cec-a0d9-12a8658f5dda tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:09.236317 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-0874773f-ea62-4cec-a0d9-12a8658f5dda tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048701 Oct 11 12:08:09.236928 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 339/688] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Oct 11 12:08:09 2022] GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:08:10.251747 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-444f3b12-7d73-4107-a338-a4338c83ed5d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:10.254176 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-444f3b12-7d73-4107-a338-a4338c83ed5d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: c568e704-7d29-4312-957d-35ed16806e9e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:10.260711 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-444f3b12-7d73-4107-a338-a4338c83ed5d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:10.261176 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-444f3b12-7d73-4107-a338-a4338c83ed5d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:10.261625 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-444f3b12-7d73-4107-a338-a4338c83ed5d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:10.262319 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-444f3b12-7d73-4107-a338-a4338c83ed5d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:10.262788 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-444f3b12-7d73-4107-a338-a4338c83ed5d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:10.263204 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-444f3b12-7d73-4107-a338-a4338c83ed5d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:10.294121 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-444f3b12-7d73-4107-a338-a4338c83ed5d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048500 Oct 11 12:08:10.294709 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 350/689] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Oct 11 12:08:10 2022] GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 12:08:10.380076 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-e3d7bf63-3af3-42bf-bc30-3fcd09a45ae6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:10.380656 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-e3d7bf63-3af3-42bf-bc30-3fcd09a45ae6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: c568e704-7d29-4312-957d-35ed16806e9e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:10.387441 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e3d7bf63-3af3-42bf-bc30-3fcd09a45ae6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:10.387922 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e3d7bf63-3af3-42bf-bc30-3fcd09a45ae6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:10.388350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e3d7bf63-3af3-42bf-bc30-3fcd09a45ae6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:10.389031 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e3d7bf63-3af3-42bf-bc30-3fcd09a45ae6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:10.389472 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e3d7bf63-3af3-42bf-bc30-3fcd09a45ae6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:10.389892 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e3d7bf63-3af3-42bf-bc30-3fcd09a45ae6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:10.416379 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-e3d7bf63-3af3-42bf-bc30-3fcd09a45ae6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: c568e704-7d29-4312-957d-35ed16806e9e] Going to try to terminate instance {{(pid=118994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 12:08:10.497139 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-e3d7bf63-3af3-42bf-bc30-3fcd09a45ae6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e" status: 204 len: 0 microversion: 2.1 time: 0.120534 Oct 11 12:08:10.498158 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 340/690] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Oct 11 12:08:10 2022] DELETE /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 12:08:10.508423 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9fe0ae1d-d699-4ad2-8bf0-00bdbb96f258 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:10.509037 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9fe0ae1d-d699-4ad2-8bf0-00bdbb96f258 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: c568e704-7d29-4312-957d-35ed16806e9e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:10.515552 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9fe0ae1d-d699-4ad2-8bf0-00bdbb96f258 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:10.516030 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9fe0ae1d-d699-4ad2-8bf0-00bdbb96f258 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:10.516455 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9fe0ae1d-d699-4ad2-8bf0-00bdbb96f258 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:10.517150 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9fe0ae1d-d699-4ad2-8bf0-00bdbb96f258 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:10.517971 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9fe0ae1d-d699-4ad2-8bf0-00bdbb96f258 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:10.518388 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9fe0ae1d-d699-4ad2-8bf0-00bdbb96f258 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:10.672003 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-9fe0ae1d-d699-4ad2-8bf0-00bdbb96f258 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:08:10.682113 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9fe0ae1d-d699-4ad2-8bf0-00bdbb96f258 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e" status: 200 len: 1681 microversion: 2.1 time: 0.178664 Oct 11 12:08:10.682707 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 351/691] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:08:10 2022] GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:08:11.706015 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-ff79ef8c-cc97-4ac8-930c-0f0836e66f96 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:11.706734 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-ff79ef8c-cc97-4ac8-930c-0f0836e66f96 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: c568e704-7d29-4312-957d-35ed16806e9e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:11.713221 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ff79ef8c-cc97-4ac8-930c-0f0836e66f96 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:11.713697 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ff79ef8c-cc97-4ac8-930c-0f0836e66f96 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:11.714172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ff79ef8c-cc97-4ac8-930c-0f0836e66f96 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:11.714833 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ff79ef8c-cc97-4ac8-930c-0f0836e66f96 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:11.715273 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ff79ef8c-cc97-4ac8-930c-0f0836e66f96 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:11.715686 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ff79ef8c-cc97-4ac8-930c-0f0836e66f96 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:11.853757 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-ff79ef8c-cc97-4ac8-930c-0f0836e66f96 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:08:11.861784 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-ff79ef8c-cc97-4ac8-930c-0f0836e66f96 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e" status: 200 len: 1681 microversion: 2.1 time: 0.160127 Oct 11 12:08:11.862350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 341/692] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:08:11 2022] GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:08:12.887827 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c0438915-007e-41b8-b26f-599965026ff7 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:12.888845 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c0438915-007e-41b8-b26f-599965026ff7 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: c568e704-7d29-4312-957d-35ed16806e9e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:12.896989 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c0438915-007e-41b8-b26f-599965026ff7 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:12.897486 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c0438915-007e-41b8-b26f-599965026ff7 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:12.897881 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c0438915-007e-41b8-b26f-599965026ff7 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:12.898606 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c0438915-007e-41b8-b26f-599965026ff7 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:12.899073 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c0438915-007e-41b8-b26f-599965026ff7 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:12.899559 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c0438915-007e-41b8-b26f-599965026ff7 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:13.138930 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c0438915-007e-41b8-b26f-599965026ff7 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:08:13.149793 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c0438915-007e-41b8-b26f-599965026ff7 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e" status: 200 len: 1681 microversion: 2.1 time: 0.265832 Oct 11 12:08:13.152433 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 352/693] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:08:12 2022] GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e => generated 1681 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:08:13.697790 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-f6c95611-b663-4a6b-bd20-b5af67c28037 req-669f88c2-6cea-4f7b-8e9c-7406329a0e4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c568e704-7d29-4312-957d-35ed16806e9e", "name": "network-vif-deleted", "tag": "5c5667a7-9915-4e21-9a3f-6ce9fdca27f9"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:08:13.708998 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-f6c95611-b663-4a6b-bd20-b5af67c28037 req-669f88c2-6cea-4f7b-8e9c-7406329a0e4f service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:13.709465 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-f6c95611-b663-4a6b-bd20-b5af67c28037 req-669f88c2-6cea-4f7b-8e9c-7406329a0e4f service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:13.710095 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-f6c95611-b663-4a6b-bd20-b5af67c28037 req-669f88c2-6cea-4f7b-8e9c-7406329a0e4f service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:13.726346 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-f6c95611-b663-4a6b-bd20-b5af67c28037 req-669f88c2-6cea-4f7b-8e9c-7406329a0e4f service nova] Creating event network-vif-deleted:5c5667a7-9915-4e21-9a3f-6ce9fdca27f9 for instance c568e704-7d29-4312-957d-35ed16806e9e on hv-cinder-82099 Oct 11 12:08:13.733195 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-f6c95611-b663-4a6b-bd20-b5af67c28037 req-669f88c2-6cea-4f7b-8e9c-7406329a0e4f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038826 Oct 11 12:08:13.735319 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 342/694] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:08:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:08:14.176534 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-063b31e4-c68e-4dcd-9266-fd50bd3066a8 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:14.177120 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-063b31e4-c68e-4dcd-9266-fd50bd3066a8 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: c568e704-7d29-4312-957d-35ed16806e9e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:14.184548 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-063b31e4-c68e-4dcd-9266-fd50bd3066a8 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:14.185045 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-063b31e4-c68e-4dcd-9266-fd50bd3066a8 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:14.185446 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-063b31e4-c68e-4dcd-9266-fd50bd3066a8 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:14.186165 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-063b31e4-c68e-4dcd-9266-fd50bd3066a8 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:14.186625 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-063b31e4-c68e-4dcd-9266-fd50bd3066a8 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:14.187042 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-063b31e4-c68e-4dcd-9266-fd50bd3066a8 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:14.223213 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-063b31e4-c68e-4dcd-9266-fd50bd3066a8 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:14.223691 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-063b31e4-c68e-4dcd-9266-fd50bd3066a8 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:14.224112 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-063b31e4-c68e-4dcd-9266-fd50bd3066a8 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:14.224652 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-063b31e4-c68e-4dcd-9266-fd50bd3066a8 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lazy-loading 'fault' on Instance uuid c568e704-7d29-4312-957d-35ed16806e9e {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:08:14.271767 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-063b31e4-c68e-4dcd-9266-fd50bd3066a8 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:08:14.283753 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-063b31e4-c68e-4dcd-9266-fd50bd3066a8 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e" status: 200 len: 1331 microversion: 2.1 time: 0.111035 Oct 11 12:08:14.284824 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 353/695] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:08:14 2022] GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e => generated 1331 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:08:15.310848 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-4a7d24d9-ca1b-44e1-a62c-bacf7d5af2d9 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:15.311546 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-4a7d24d9-ca1b-44e1-a62c-bacf7d5af2d9 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: c568e704-7d29-4312-957d-35ed16806e9e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:15.318348 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4a7d24d9-ca1b-44e1-a62c-bacf7d5af2d9 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:15.318857 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4a7d24d9-ca1b-44e1-a62c-bacf7d5af2d9 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:15.319287 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4a7d24d9-ca1b-44e1-a62c-bacf7d5af2d9 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:15.319972 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4a7d24d9-ca1b-44e1-a62c-bacf7d5af2d9 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:15.320422 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4a7d24d9-ca1b-44e1-a62c-bacf7d5af2d9 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:15.320845 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4a7d24d9-ca1b-44e1-a62c-bacf7d5af2d9 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:15.336795 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.wsgi [None req-4a7d24d9-ca1b-44e1-a62c-bacf7d5af2d9 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] HTTP exception thrown: Instance c568e704-7d29-4312-957d-35ed16806e9e could not be found. Oct 11 12:08:15.338463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-4a7d24d9-ca1b-44e1-a62c-bacf7d5af2d9 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Request method failure captured: Oct 11 12:08:15.338463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: request: GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e HTTP/1.1 Oct 11 12:08:15.338463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept: application/json Oct 11 12:08:15.338463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept-Encoding: identity Oct 11 12:08:15.338463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Connection: close Oct 11 12:08:15.338463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Length: 0 Oct 11 12:08:15.338463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Type: application/json Oct 11 12:08:15.338463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Host: 10.222.0.59 Oct 11 12:08:15.338463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Openstack-System-Scope: None Oct 11 12:08:15.338463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: User-Agent: python-urllib3/1.26.12 Oct 11 12:08:15.338463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Auth-Token: gAAAAABjRVrDbBzKTyV9eZUXZryLVe-KpT4WYEHJaER5TFyRAvTSEg5lw7FxKmfGi17rpAnxooOQ2r63AULbLGHHY4hm760kGTTUbeHuyR9-shGVTsiYjly6leZlsPXT8VYCrZ-E0QA-DYApJOgvSEAYz3JHEXcb3Qg12yFjALYOMVuEZNDDhBk Oct 11 12:08:15.338463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Id: None Oct 11 12:08:15.338463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Name: None Oct 11 12:08:15.338463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Identity-Status: Confirmed Oct 11 12:08:15.338463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Is-Admin-Project: True Oct 11 12:08:15.338463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Id: default Oct 11 12:08:15.338463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Name: Default Oct 11 12:08:15.338463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Id: c83f971a0ae04288a5c6dc87d3370979 Oct 11 12:08:15.338463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Name: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:08:15.338463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Role: reader,member Oct 11 12:08:15.338463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Roles: reader,member Oct 11 12:08:15.340088 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:08:15.340088 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:08:15.340088 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Id: c83f971a0ae04288a5c6dc87d3370979 Oct 11 12:08:15.340088 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:08:15.340088 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User: tempest-AttachVolumeNegativeTest-1543839758-project Oct 11 12:08:15.340088 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Id: default Oct 11 12:08:15.340088 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Name: Default Oct 11 12:08:15.340088 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Id: 41d3680dda7c4cc8aeb6d086efca0775 Oct 11 12:08:15.340088 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Name: tempest-AttachVolumeNegativeTest-1543839758-project Oct 11 12:08:15.340088 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: method: > Oct 11 12:08:15.340088 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: exception: Instance c568e704-7d29-4312-957d-35ed16806e9e could not be found. Oct 11 12:08:15.340088 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: action_args: {'id': 'c568e704-7d29-4312-957d-35ed16806e9e'} Oct 11 12:08:15.340958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:08:15.340958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:08:15.340958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:08:15.340958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:08:15.340958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:08:15.340958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:08:15.340958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:08:15.340958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:08:15.340958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:08:15.340958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:08:15.340958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c568e704-7d29-4312-957d-35ed16806e9e could not be found. Oct 11 12:08:15.340958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:08:15.340958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:08:15.340958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:08:15.340958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:08:15.340958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:08:15.340958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:08:15.340958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:08:15.340958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:08:15.340958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:08:15.342355 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:08:15.342355 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 12:08:15.342355 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 12:08:15.342355 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:08:15.342355 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:08:15.342355 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:08:15.342355 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:08:15.342355 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c568e704-7d29-4312-957d-35ed16806e9e could not be found. Oct 11 12:08:15.342355 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:08:15.342355 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:08:15.342355 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:08:15.342355 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:08:15.342355 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:08:15.342355 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:08:15.342355 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:08:15.342355 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:08:15.342355 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c568e704-7d29-4312-957d-35ed16806e9e could not be found. Oct 11 12:08:15.342355 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:08:15.343718 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-4a7d24d9-ca1b-44e1-a62c-bacf7d5af2d9 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Returning 404 to user: Instance c568e704-7d29-4312-957d-35ed16806e9e could not be found. {{(pid=118994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:08:15.343718 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-4a7d24d9-ca1b-44e1-a62c-bacf7d5af2d9 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e" status: 404 len: 111 microversion: 2.1 time: 0.034028 Oct 11 12:08:15.343718 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 343/696] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:08:15 2022] GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:08:15.350051 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7c2191f2-e4a4-48d5-b933-f02445a4ad86 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '.version_select at 0x7fd40662c280>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:15.372041 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7c2191f2-e4a4-48d5-b933-f02445a4ad86 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-753044975" status: 202 len: 0 microversion: 2.1 time: 0.025785 Oct 11 12:08:15.373021 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 354/697] 10.222.0.59 () {58 vars in 1218 bytes} [Tue Oct 11 12:08:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-753044975 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 12:08:16.265216 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-f370dc0d-d95b-42a6-bcc9-c8a35019daf1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Action: 'create', calling method: .version_select at 0x7fd406828ca0>, body: {"keypair": {"name": "tempest-keypair-1990618407", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKXh2SmbZPS6zPjZ5HDQfJIzgu6IbIAJt4yF7N72vX91QrCq0OL1+0maF6b1EBNmERiEWma6Ha8bEqu/ktlNLW8/4HoTTMavzJpp0aMK4koHGN8ncijwRreWHAPMkN/exw=="}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:08:16.281343 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-f370dc0d-d95b-42a6-bcc9-c8a35019daf1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Getting quotas for project c83f971a0ae04288a5c6dc87d3370979. Resources: {'key_pairs'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 12:08:16.285467 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-f370dc0d-d95b-42a6-bcc9-c8a35019daf1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Getting quotas for user 41d3680dda7c4cc8aeb6d086efca0775 and project c83f971a0ae04288a5c6dc87d3370979. Resources: {'key_pairs'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 12:08:16.308978 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-f370dc0d-d95b-42a6-bcc9-c8a35019daf1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047690 Oct 11 12:08:16.309589 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 344/698] 10.222.0.59 () {60 vars in 1159 bytes} [Tue Oct 11 12:08:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:08:17.688094 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2aa47fc6-0b7e-47df-881f-6711fb047d77 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1621135362", "imageRef": "09bcc8f8-a32f-4ec8-9ab2-a98964ad6a01", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "55e10b58-1f19-4291-9200-8a870118bbcb"}], "security_groups": [{"name": "tempest-securitygroup--1598387768"}], "key_name": "tempest-keypair-1990618407", "user_data": "}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:08:17.797445 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.network.neutron [None req-2aa47fc6-0b7e-47df-881f-6711fb047d77 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] validate_networks() for [('55e10b58-1f19-4291-9200-8a870118bbcb', None, None, None, None, None)] {{(pid=118995) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 12:08:18.196693 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-2aa47fc6-0b7e-47df-881f-6711fb047d77 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Flavor limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 12:08:18.197218 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-2aa47fc6-0b7e-47df-881f-6711fb047d77 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Image limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 12:08:18.197682 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-2aa47fc6-0b7e-47df-881f-6711fb047d77 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Flavor pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 12:08:18.198077 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-2aa47fc6-0b7e-47df-881f-6711fb047d77 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Image pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 12:08:18.198475 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-2aa47fc6-0b7e-47df-881f-6711fb047d77 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 12:08:18.207870 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2aa47fc6-0b7e-47df-881f-6711fb047d77 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:18.208338 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2aa47fc6-0b7e-47df-881f-6711fb047d77 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:18.208762 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2aa47fc6-0b7e-47df-881f-6711fb047d77 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:18.209463 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2aa47fc6-0b7e-47df-881f-6711fb047d77 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:18.209905 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2aa47fc6-0b7e-47df-881f-6711fb047d77 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:18.210314 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2aa47fc6-0b7e-47df-881f-6711fb047d77 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:18.232841 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-2aa47fc6-0b7e-47df-881f-6711fb047d77 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Getting quotas for project c83f971a0ae04288a5c6dc87d3370979. Resources: {'ram', 'instances', 'cores'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 12:08:18.239966 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-2aa47fc6-0b7e-47df-881f-6711fb047d77 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Getting quotas for user 41d3680dda7c4cc8aeb6d086efca0775 and project c83f971a0ae04288a5c6dc87d3370979. Resources: {'ram', 'instances', 'cores'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 12:08:18.259200 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2aa47fc6-0b7e-47df-881f-6711fb047d77 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Going to run 1 instances... {{(pid=118995) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 12:08:18.263704 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2aa47fc6-0b7e-47df-881f-6711fb047d77 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09bcc8f8-a32f-4ec8-9ab2-a98964ad6a01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118995) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 12:08:18.352845 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2aa47fc6-0b7e-47df-881f-6711fb047d77 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.671790 Oct 11 12:08:18.354009 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 355/699] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Oct 11 12:08:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 12:08:18.374771 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-aa154e40-3d27-4454-98b8-52fce5b6cdbc tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:18.375894 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-aa154e40-3d27-4454-98b8-52fce5b6cdbc tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:18.437845 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-aa154e40-3d27-4454-98b8-52fce5b6cdbc tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:08:18.445640 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-aa154e40-3d27-4454-98b8-52fce5b6cdbc tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38" status: 200 len: 1242 microversion: 2.1 time: 0.078976 Oct 11 12:08:18.446524 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 345/700] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:08:18 2022] GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:08:19.476690 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-30976a7d-1ea5-4a0c-ae15-f00381d08e18 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:19.477264 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-30976a7d-1ea5-4a0c-ae15-f00381d08e18 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:19.485973 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-30976a7d-1ea5-4a0c-ae15-f00381d08e18 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:19.486760 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-30976a7d-1ea5-4a0c-ae15-f00381d08e18 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:19.487385 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-30976a7d-1ea5-4a0c-ae15-f00381d08e18 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:19.488421 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-30976a7d-1ea5-4a0c-ae15-f00381d08e18 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:19.489091 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-30976a7d-1ea5-4a0c-ae15-f00381d08e18 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:19.489682 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-30976a7d-1ea5-4a0c-ae15-f00381d08e18 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:19.555149 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-30976a7d-1ea5-4a0c-ae15-f00381d08e18 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:08:19.564139 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-30976a7d-1ea5-4a0c-ae15-f00381d08e18 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38" status: 200 len: 1294 microversion: 2.1 time: 0.093569 Oct 11 12:08:19.564725 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 356/701] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:08:19 2022] GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 => generated 1294 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:08:20.587710 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-2b3b7a00-10cb-4704-abb2-1cd08394dc10 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:20.589053 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-2b3b7a00-10cb-4704-abb2-1cd08394dc10 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:20.595541 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2b3b7a00-10cb-4704-abb2-1cd08394dc10 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:20.596040 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2b3b7a00-10cb-4704-abb2-1cd08394dc10 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:20.596447 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2b3b7a00-10cb-4704-abb2-1cd08394dc10 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:20.597378 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2b3b7a00-10cb-4704-abb2-1cd08394dc10 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:20.597982 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2b3b7a00-10cb-4704-abb2-1cd08394dc10 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:20.598590 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2b3b7a00-10cb-4704-abb2-1cd08394dc10 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:20.744681 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-2b3b7a00-10cb-4704-abb2-1cd08394dc10 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:08:20.753098 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-2b3b7a00-10cb-4704-abb2-1cd08394dc10 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38" status: 200 len: 1368 microversion: 2.1 time: 0.169413 Oct 11 12:08:20.753680 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 346/702] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:08:20 2022] GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 => generated 1368 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:08:21.372281 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-8862de6f-11a4-47a1-90e3-8175066a5c0f req-c5e7d5f4-6e93-4e94-9489-34559bc870a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5902c505-fc30-4239-b20e-2b5b1f213c38", "tag": "b29d9996-d1dc-46fb-aba2-3d0f27d4ffba"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:08:21.387566 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-8862de6f-11a4-47a1-90e3-8175066a5c0f req-c5e7d5f4-6e93-4e94-9489-34559bc870a0 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:21.388085 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-8862de6f-11a4-47a1-90e3-8175066a5c0f req-c5e7d5f4-6e93-4e94-9489-34559bc870a0 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:21.388560 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-8862de6f-11a4-47a1-90e3-8175066a5c0f req-c5e7d5f4-6e93-4e94-9489-34559bc870a0 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:21.401631 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-8862de6f-11a4-47a1-90e3-8175066a5c0f req-c5e7d5f4-6e93-4e94-9489-34559bc870a0 service nova] Creating event network-changed:b29d9996-d1dc-46fb-aba2-3d0f27d4ffba for instance 5902c505-fc30-4239-b20e-2b5b1f213c38 on hv-cinder-82099 Oct 11 12:08:21.407763 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-8862de6f-11a4-47a1-90e3-8175066a5c0f req-c5e7d5f4-6e93-4e94-9489-34559bc870a0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046388 Oct 11 12:08:21.408644 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 357/703] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:08:21.777358 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-56b30c45-0fa6-4699-92f0-d0db88bf69c0 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:21.777976 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-56b30c45-0fa6-4699-92f0-d0db88bf69c0 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:21.784977 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-56b30c45-0fa6-4699-92f0-d0db88bf69c0 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:21.785464 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-56b30c45-0fa6-4699-92f0-d0db88bf69c0 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:21.785896 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-56b30c45-0fa6-4699-92f0-d0db88bf69c0 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:21.786610 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-56b30c45-0fa6-4699-92f0-d0db88bf69c0 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:21.787093 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-56b30c45-0fa6-4699-92f0-d0db88bf69c0 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:21.787491 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-56b30c45-0fa6-4699-92f0-d0db88bf69c0 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:21.931190 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-56b30c45-0fa6-4699-92f0-d0db88bf69c0 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:08:21.939125 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-56b30c45-0fa6-4699-92f0-d0db88bf69c0 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38" status: 200 len: 1368 microversion: 2.1 time: 0.166199 Oct 11 12:08:21.939704 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 347/704] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:08:21 2022] GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:08:22.731955 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3c60f50e-625f-4fb1-9e8a-820697b99255 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:22.734342 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-3c60f50e-625f-4fb1-9e8a-820697b99255 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:22.741093 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3c60f50e-625f-4fb1-9e8a-820697b99255 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:22.741574 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3c60f50e-625f-4fb1-9e8a-820697b99255 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:22.742005 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3c60f50e-625f-4fb1-9e8a-820697b99255 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:22.742748 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3c60f50e-625f-4fb1-9e8a-820697b99255 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:22.743203 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3c60f50e-625f-4fb1-9e8a-820697b99255 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:22.743625 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3c60f50e-625f-4fb1-9e8a-820697b99255 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:22.776261 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-3c60f50e-625f-4fb1-9e8a-820697b99255 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050516 Oct 11 12:08:22.776844 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 358/705] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Oct 11 12:08:22 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 12:08:22.854835 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-2a4457ad-3139-44ae-b57b-c612ba19b3f4 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:22.855419 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-2a4457ad-3139-44ae-b57b-c612ba19b3f4 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:22.862330 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2a4457ad-3139-44ae-b57b-c612ba19b3f4 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:22.862965 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2a4457ad-3139-44ae-b57b-c612ba19b3f4 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:22.863410 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2a4457ad-3139-44ae-b57b-c612ba19b3f4 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:22.864097 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2a4457ad-3139-44ae-b57b-c612ba19b3f4 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:22.864559 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2a4457ad-3139-44ae-b57b-c612ba19b3f4 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:22.865004 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2a4457ad-3139-44ae-b57b-c612ba19b3f4 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:22.890915 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-2a4457ad-3139-44ae-b57b-c612ba19b3f4 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Going to try to terminate instance {{(pid=118994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 12:08:22.963341 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-06a87feb-1fc8-4657-aa1b-ad349f74de4a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:22.963664 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-06a87feb-1fc8-4657-aa1b-ad349f74de4a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:22.971088 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06a87feb-1fc8-4657-aa1b-ad349f74de4a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:22.971644 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06a87feb-1fc8-4657-aa1b-ad349f74de4a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:22.971987 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06a87feb-1fc8-4657-aa1b-ad349f74de4a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:22.972679 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06a87feb-1fc8-4657-aa1b-ad349f74de4a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:22.973127 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06a87feb-1fc8-4657-aa1b-ad349f74de4a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:22.973539 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06a87feb-1fc8-4657-aa1b-ad349f74de4a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:22.989428 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-2a4457ad-3139-44ae-b57b-c612ba19b3f4 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "DELETE /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 204 len: 0 microversion: 2.1 time: 0.139580 Oct 11 12:08:22.990046 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 348/706] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Oct 11 12:08:22 2022] DELETE /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 12:08:22.998866 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-f9b9fab2-fd8f-4e1d-a8b1-c8bd65430ba9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:22.999554 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-f9b9fab2-fd8f-4e1d-a8b1-c8bd65430ba9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:23.005549 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f9b9fab2-fd8f-4e1d-a8b1-c8bd65430ba9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:23.006032 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f9b9fab2-fd8f-4e1d-a8b1-c8bd65430ba9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:23.006467 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f9b9fab2-fd8f-4e1d-a8b1-c8bd65430ba9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:23.007227 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f9b9fab2-fd8f-4e1d-a8b1-c8bd65430ba9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:23.007723 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f9b9fab2-fd8f-4e1d-a8b1-c8bd65430ba9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:23.008171 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f9b9fab2-fd8f-4e1d-a8b1-c8bd65430ba9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:23.011114 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:23.105572 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-06a87feb-1fc8-4657-aa1b-ad349f74de4a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:08:23.113463 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-06a87feb-1fc8-4657-aa1b-ad349f74de4a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38" status: 200 len: 1368 microversion: 2.1 time: 0.154774 Oct 11 12:08:23.114019 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 359/707] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:08:22 2022] GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:08:23.146407 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-f9b9fab2-fd8f-4e1d-a8b1-c8bd65430ba9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:08:23.155825 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-f9b9fab2-fd8f-4e1d-a8b1-c8bd65430ba9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1674 microversion: 2.1 time: 0.161104 Oct 11 12:08:23.156408 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 349/708] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:08:22 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:08:24.139678 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9f1f99f2-7a72-444a-b725-a8243e6b7107 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:24.140257 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9f1f99f2-7a72-444a-b725-a8243e6b7107 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:24.150070 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9f1f99f2-7a72-444a-b725-a8243e6b7107 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:24.150847 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9f1f99f2-7a72-444a-b725-a8243e6b7107 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:24.151271 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9f1f99f2-7a72-444a-b725-a8243e6b7107 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:24.151937 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9f1f99f2-7a72-444a-b725-a8243e6b7107 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:24.152374 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9f1f99f2-7a72-444a-b725-a8243e6b7107 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:24.152807 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9f1f99f2-7a72-444a-b725-a8243e6b7107 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:24.179678 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-8286f333-fa6a-436f-add2-18427648a330 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:24.180225 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-8286f333-fa6a-436f-add2-18427648a330 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:24.187036 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8286f333-fa6a-436f-add2-18427648a330 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:24.187519 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8286f333-fa6a-436f-add2-18427648a330 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:24.187942 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8286f333-fa6a-436f-add2-18427648a330 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:24.188636 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8286f333-fa6a-436f-add2-18427648a330 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:24.189081 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8286f333-fa6a-436f-add2-18427648a330 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:24.189498 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8286f333-fa6a-436f-add2-18427648a330 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:24.295810 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-9f1f99f2-7a72-444a-b725-a8243e6b7107 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:08:24.304062 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9f1f99f2-7a72-444a-b725-a8243e6b7107 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38" status: 200 len: 1368 microversion: 2.1 time: 0.170467 Oct 11 12:08:24.304664 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 360/709] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:08:24 2022] GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:08:24.327125 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-8286f333-fa6a-436f-add2-18427648a330 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:08:24.335085 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-8286f333-fa6a-436f-add2-18427648a330 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1674 microversion: 2.1 time: 0.159211 Oct 11 12:08:24.335629 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 350/710] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:08:24 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:08:25.327250 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-511e387b-2697-479f-b972-414f8b3ae7be tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:25.327868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-511e387b-2697-479f-b972-414f8b3ae7be tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:25.334532 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-511e387b-2697-479f-b972-414f8b3ae7be tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:25.335044 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-511e387b-2697-479f-b972-414f8b3ae7be tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:25.335480 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-511e387b-2697-479f-b972-414f8b3ae7be tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:25.336194 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-511e387b-2697-479f-b972-414f8b3ae7be tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:25.336646 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-511e387b-2697-479f-b972-414f8b3ae7be tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:25.337272 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-511e387b-2697-479f-b972-414f8b3ae7be tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:25.359066 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-e746eb32-c24f-4650-9fad-07311b3999d3 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:25.359700 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-e746eb32-c24f-4650-9fad-07311b3999d3 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:25.366764 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e746eb32-c24f-4650-9fad-07311b3999d3 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:25.367672 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e746eb32-c24f-4650-9fad-07311b3999d3 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:25.368333 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e746eb32-c24f-4650-9fad-07311b3999d3 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:25.369523 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e746eb32-c24f-4650-9fad-07311b3999d3 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:25.369975 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e746eb32-c24f-4650-9fad-07311b3999d3 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:25.370599 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e746eb32-c24f-4650-9fad-07311b3999d3 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:25.539207 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-511e387b-2697-479f-b972-414f8b3ae7be tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:08:25.544698 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-e746eb32-c24f-4650-9fad-07311b3999d3 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:08:25.547438 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-511e387b-2697-479f-b972-414f8b3ae7be tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38" status: 200 len: 1368 microversion: 2.1 time: 0.224681 Oct 11 12:08:25.547987 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 361/711] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:08:25 2022] GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 => generated 1368 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:08:25.553114 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-e746eb32-c24f-4650-9fad-07311b3999d3 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1674 microversion: 2.1 time: 0.198359 Oct 11 12:08:25.553767 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 351/712] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:08:25 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1674 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:08:26.571510 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-cb329525-4d85-410b-8f96-ce031c4a5fcd tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:26.572274 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-cb329525-4d85-410b-8f96-ce031c4a5fcd tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:26.578330 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-3ddec8eb-1408-4b11-aa8c-9e3003a877c9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:26.579137 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-3ddec8eb-1408-4b11-aa8c-9e3003a877c9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:26.579280 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cb329525-4d85-410b-8f96-ce031c4a5fcd tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:26.579670 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cb329525-4d85-410b-8f96-ce031c4a5fcd tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:26.580122 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cb329525-4d85-410b-8f96-ce031c4a5fcd tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:26.580834 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cb329525-4d85-410b-8f96-ce031c4a5fcd tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:26.581261 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cb329525-4d85-410b-8f96-ce031c4a5fcd tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:26.581879 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cb329525-4d85-410b-8f96-ce031c4a5fcd tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:26.588367 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3ddec8eb-1408-4b11-aa8c-9e3003a877c9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:26.588972 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3ddec8eb-1408-4b11-aa8c-9e3003a877c9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:26.589465 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3ddec8eb-1408-4b11-aa8c-9e3003a877c9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:26.590221 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3ddec8eb-1408-4b11-aa8c-9e3003a877c9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:26.590770 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3ddec8eb-1408-4b11-aa8c-9e3003a877c9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:26.591376 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3ddec8eb-1408-4b11-aa8c-9e3003a877c9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:26.658169 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-3ddec8eb-1408-4b11-aa8c-9e3003a877c9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:08:26.667927 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-3ddec8eb-1408-4b11-aa8c-9e3003a877c9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 200 len: 1606 microversion: 2.1 time: 0.094356 Oct 11 12:08:26.668666 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 352/713] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:08:26 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 1606 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:08:26.702960 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-8e625ba0-9645-44ac-a28b-0cf5870801f5 req-0b31ea59-fd81-4469-869a-8b691e41bb6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3277e26-d502-49fd-ba21-b427effd9d91", "name": "network-vif-deleted", "tag": "8addee64-ef1f-4a6a-8f09-b378e453cff5"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:08:26.717212 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-8e625ba0-9645-44ac-a28b-0cf5870801f5 req-0b31ea59-fd81-4469-869a-8b691e41bb6b service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:26.717883 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-8e625ba0-9645-44ac-a28b-0cf5870801f5 req-0b31ea59-fd81-4469-869a-8b691e41bb6b service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:26.718488 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-8e625ba0-9645-44ac-a28b-0cf5870801f5 req-0b31ea59-fd81-4469-869a-8b691e41bb6b service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:26.737427 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-8e625ba0-9645-44ac-a28b-0cf5870801f5 req-0b31ea59-fd81-4469-869a-8b691e41bb6b service nova] Creating event network-vif-deleted:8addee64-ef1f-4a6a-8f09-b378e453cff5 for instance e3277e26-d502-49fd-ba21-b427effd9d91 on hv-cinder-82099 Oct 11 12:08:26.744421 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-8e625ba0-9645-44ac-a28b-0cf5870801f5 req-0b31ea59-fd81-4469-869a-8b691e41bb6b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044765 Oct 11 12:08:26.745980 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 353/714] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:08:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:08:26.800091 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-cb329525-4d85-410b-8f96-ce031c4a5fcd tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:08:26.810135 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-cb329525-4d85-410b-8f96-ce031c4a5fcd tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38" status: 200 len: 1368 microversion: 2.1 time: 0.242663 Oct 11 12:08:26.810777 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 362/715] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:08:26 2022] GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 => generated 1368 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:08:27.594261 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-525615a1-09c1-44bf-a79a-5db53d032267 req-666929f2-ce7c-4d61-823b-5fc6ca7b0b9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5902c505-fc30-4239-b20e-2b5b1f213c38", "name": "network-vif-plugged", "status": "completed", "tag": "b29d9996-d1dc-46fb-aba2-3d0f27d4ffba"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:08:27.605106 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-525615a1-09c1-44bf-a79a-5db53d032267 req-666929f2-ce7c-4d61-823b-5fc6ca7b0b9e service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:27.605578 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-525615a1-09c1-44bf-a79a-5db53d032267 req-666929f2-ce7c-4d61-823b-5fc6ca7b0b9e service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:27.605985 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-525615a1-09c1-44bf-a79a-5db53d032267 req-666929f2-ce7c-4d61-823b-5fc6ca7b0b9e service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:27.618798 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-525615a1-09c1-44bf-a79a-5db53d032267 req-666929f2-ce7c-4d61-823b-5fc6ca7b0b9e service nova] Creating event network-vif-plugged:b29d9996-d1dc-46fb-aba2-3d0f27d4ffba for instance 5902c505-fc30-4239-b20e-2b5b1f213c38 on hv-cinder-82099 Oct 11 12:08:27.624401 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-525615a1-09c1-44bf-a79a-5db53d032267 req-666929f2-ce7c-4d61-823b-5fc6ca7b0b9e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034758 Oct 11 12:08:27.625019 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 354/716] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:08:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:08:27.692215 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e99f0481-5d1a-4f5f-a5cb-b65577e62391 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:27.693016 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e99f0481-5d1a-4f5f-a5cb-b65577e62391 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:27.699648 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e99f0481-5d1a-4f5f-a5cb-b65577e62391 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:27.700298 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e99f0481-5d1a-4f5f-a5cb-b65577e62391 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:27.700735 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e99f0481-5d1a-4f5f-a5cb-b65577e62391 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:27.701497 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e99f0481-5d1a-4f5f-a5cb-b65577e62391 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:27.701956 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e99f0481-5d1a-4f5f-a5cb-b65577e62391 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:27.702680 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e99f0481-5d1a-4f5f-a5cb-b65577e62391 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:27.719300 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-e99f0481-5d1a-4f5f-a5cb-b65577e62391 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] HTTP exception thrown: Instance e3277e26-d502-49fd-ba21-b427effd9d91 could not be found. Oct 11 12:08:27.721534 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e99f0481-5d1a-4f5f-a5cb-b65577e62391 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Request method failure captured: Oct 11 12:08:27.721534 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 HTTP/1.1 Oct 11 12:08:27.721534 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 11 12:08:27.721534 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 11 12:08:27.721534 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Connection: close Oct 11 12:08:27.721534 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 11 12:08:27.721534 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 11 12:08:27.721534 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Host: 10.222.0.59 Oct 11 12:08:27.721534 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 11 12:08:27.721534 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 11 12:08:27.721534 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjRVs9QtNHBzSTX4aaGIn1kjA3g8hCveim2qiQItdwRP8ypMDo8vouc4V172UwiJwCvsASOxUr3GqC_0b097Blcy0Id7ENCk6xsYTLbUSoUKy0bmF_QHk7OkvwiTjtN93jNN2lvdXFSEWe6-0SgSs_4_52JIjrHwCFI_UNfqPxe1BXzqg Oct 11 12:08:27.721534 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 11 12:08:27.721534 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 11 12:08:27.721534 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 11 12:08:27.721534 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 11 12:08:27.721534 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 11 12:08:27.721534 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 11 12:08:27.721534 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Id: 9a7beb3a9d2b4ee9ba323d5bccc618c2 Oct 11 12:08:27.721534 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-AttachVolumeTestJSON-2100711064 Oct 11 12:08:27.721534 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Role: reader,member Oct 11 12:08:27.721534 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Roles: reader,member Oct 11 12:08:27.723011 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9a7beb3a9d2b4ee9ba323d5bccc618c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9a7beb3a9d2b4ee9ba323d5bccc618c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a7beb3a9d2b4ee9ba323d5bccc618c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a7beb3a9d2b4ee9ba323d5bccc618c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:08:27.723011 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-AttachVolumeTestJSON-2100711064 Oct 11 12:08:27.723011 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 9a7beb3a9d2b4ee9ba323d5bccc618c2 Oct 11 12:08:27.723011 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2100711064 Oct 11 12:08:27.723011 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User: tempest-AttachVolumeTestJSON-2100711064-project Oct 11 12:08:27.723011 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 11 12:08:27.723011 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 11 12:08:27.723011 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Id: a78e40d4eb554ca49eeec530a7adf428 Oct 11 12:08:27.723011 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-AttachVolumeTestJSON-2100711064-project Oct 11 12:08:27.723011 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: method: > Oct 11 12:08:27.723011 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: exception: Instance e3277e26-d502-49fd-ba21-b427effd9d91 could not be found. Oct 11 12:08:27.723011 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: action_args: {'id': 'e3277e26-d502-49fd-ba21-b427effd9d91'} Oct 11 12:08:27.724709 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:08:27.724709 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:08:27.724709 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:08:27.724709 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:08:27.724709 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:08:27.724709 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:08:27.724709 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:08:27.724709 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:08:27.724709 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:08:27.724709 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:08:27.724709 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3277e26-d502-49fd-ba21-b427effd9d91 could not be found. Oct 11 12:08:27.724709 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:08:27.724709 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:08:27.724709 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:08:27.724709 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:08:27.724709 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:08:27.724709 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:08:27.724709 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:08:27.724709 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:08:27.724709 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:08:27.725897 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:08:27.725897 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 12:08:27.725897 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 12:08:27.725897 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:08:27.725897 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:08:27.725897 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:08:27.725897 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:08:27.725897 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3277e26-d502-49fd-ba21-b427effd9d91 could not be found. Oct 11 12:08:27.725897 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:08:27.725897 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:08:27.725897 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:08:27.725897 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:08:27.725897 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:08:27.725897 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:08:27.725897 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:08:27.725897 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:08:27.725897 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3277e26-d502-49fd-ba21-b427effd9d91 could not be found. Oct 11 12:08:27.725897 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:08:27.729211 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e99f0481-5d1a-4f5f-a5cb-b65577e62391 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Returning 404 to user: Instance e3277e26-d502-49fd-ba21-b427effd9d91 could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:08:27.730248 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e99f0481-5d1a-4f5f-a5cb-b65577e62391 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 404 len: 111 microversion: 2.1 time: 0.042430 Oct 11 12:08:27.731230 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 363/717] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:08:27 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:08:27.740325 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-5517d8ed-9942-4b66-8c1d-26e7d9071bf2 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '.version_select at 0x7fd406786dc0>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:27.762954 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-5517d8ed-9942-4b66-8c1d-26e7d9071bf2 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1579482174" status: 202 len: 0 microversion: 2.1 time: 0.026700 Oct 11 12:08:27.767653 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 355/718] 10.222.0.59 () {58 vars in 1221 bytes} [Tue Oct 11 12:08:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1579482174 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 12:08:27.833103 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-24a53696-9146-4c32-912c-0c91fcb1b522 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:27.833722 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-24a53696-9146-4c32-912c-0c91fcb1b522 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:27.840225 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-24a53696-9146-4c32-912c-0c91fcb1b522 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:27.841003 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-24a53696-9146-4c32-912c-0c91fcb1b522 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:27.841609 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-24a53696-9146-4c32-912c-0c91fcb1b522 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:27.842347 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-24a53696-9146-4c32-912c-0c91fcb1b522 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:27.843047 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-24a53696-9146-4c32-912c-0c91fcb1b522 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:27.843696 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-24a53696-9146-4c32-912c-0c91fcb1b522 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:28.152182 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-24a53696-9146-4c32-912c-0c91fcb1b522 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:08:28.160894 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-24a53696-9146-4c32-912c-0c91fcb1b522 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38" status: 200 len: 1368 microversion: 2.1 time: 0.331728 Oct 11 12:08:28.161467 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 364/719] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:08:27 2022] GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 => generated 1368 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:08:28.520863 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell0:SELECT=6 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:28.525045 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-6f0ce278-1258-4446-a0eb-9c3bda8be11a tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Action: 'create', calling method: .version_select at 0x7fd40671d310>, body: {"keypair": {"name": "tempest-keypair-1796809927", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIs9D0At/Gf97hBfFpDKH1+owbopl8tkdIhtE3NCx+wcNeyS/PgiWCN/St4YEKcGVdWwils4ieMiqyqeQvILDgMb/7UZiGyN1ER/pI0btttGouQSsVKTMkid6RQbKtV1yw=="}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:08:28.541721 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-6f0ce278-1258-4446-a0eb-9c3bda8be11a tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Getting quotas for project 9a7beb3a9d2b4ee9ba323d5bccc618c2. Resources: {'key_pairs'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 12:08:28.546422 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-6f0ce278-1258-4446-a0eb-9c3bda8be11a tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Getting quotas for user a78e40d4eb554ca49eeec530a7adf428 and project 9a7beb3a9d2b4ee9ba323d5bccc618c2. Resources: {'key_pairs'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 12:08:28.570631 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-6f0ce278-1258-4446-a0eb-9c3bda8be11a tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050471 Oct 11 12:08:28.571217 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 356/720] 10.222.0.59 () {60 vars in 1159 bytes} [Tue Oct 11 12:08:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:08:29.183844 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-11606662-2ed4-48d9-ade2-1116dcc3c928 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:29.184555 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-11606662-2ed4-48d9-ade2-1116dcc3c928 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:29.186541 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=2 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:29.187397 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=6 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:29.195307 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-11606662-2ed4-48d9-ade2-1116dcc3c928 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:29.195776 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-11606662-2ed4-48d9-ade2-1116dcc3c928 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:29.196201 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-11606662-2ed4-48d9-ade2-1116dcc3c928 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:29.196931 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-11606662-2ed4-48d9-ade2-1116dcc3c928 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:29.197374 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-11606662-2ed4-48d9-ade2-1116dcc3c928 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:29.197813 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-11606662-2ed4-48d9-ade2-1116dcc3c928 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:29.340635 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-11606662-2ed4-48d9-ade2-1116dcc3c928 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:08:29.348649 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-11606662-2ed4-48d9-ade2-1116dcc3c928 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38" status: 200 len: 1368 microversion: 2.1 time: 0.168878 Oct 11 12:08:29.349259 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 365/721] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:08:29 2022] GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:08:30.161287 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-9c15ffe7-0b46-4116-a30b-3965a6fb123c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-57659626", "imageRef": "09bcc8f8-a32f-4ec8-9ab2-a98964ad6a01", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ae19ec92-ec5c-4f84-8d72-b606de6137b2"}], "security_groups": [{"name": "tempest-securitygroup--842503702"}], "key_name": "tempest-keypair-1796809927", "user_data": "}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:08:30.278954 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.network.neutron [None req-9c15ffe7-0b46-4116-a30b-3965a6fb123c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] validate_networks() for [('ae19ec92-ec5c-4f84-8d72-b606de6137b2', None, None, None, None, None)] {{(pid=118994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 12:08:30.371930 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-27314cf0-44ce-466d-8f97-db83c5bc01a6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:30.372569 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-27314cf0-44ce-466d-8f97-db83c5bc01a6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:30.379011 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-27314cf0-44ce-466d-8f97-db83c5bc01a6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:30.379507 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-27314cf0-44ce-466d-8f97-db83c5bc01a6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:30.379933 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-27314cf0-44ce-466d-8f97-db83c5bc01a6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:30.380637 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-27314cf0-44ce-466d-8f97-db83c5bc01a6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:30.381709 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-27314cf0-44ce-466d-8f97-db83c5bc01a6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:30.382137 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-27314cf0-44ce-466d-8f97-db83c5bc01a6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:30.386687 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:30.531649 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-27314cf0-44ce-466d-8f97-db83c5bc01a6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:08:30.539539 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-27314cf0-44ce-466d-8f97-db83c5bc01a6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38" status: 200 len: 1558 microversion: 2.1 time: 0.171526 Oct 11 12:08:30.540104 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 366/722] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:08:30 2022] GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:08:30.563272 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2485f5cf-9c01-4c2c-aae9-8e3025caf222 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:30.563853 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2485f5cf-9c01-4c2c-aae9-8e3025caf222 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:30.570094 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2485f5cf-9c01-4c2c-aae9-8e3025caf222 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:30.570712 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2485f5cf-9c01-4c2c-aae9-8e3025caf222 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:30.571217 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2485f5cf-9c01-4c2c-aae9-8e3025caf222 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:30.572204 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2485f5cf-9c01-4c2c-aae9-8e3025caf222 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:30.572645 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2485f5cf-9c01-4c2c-aae9-8e3025caf222 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:30.573094 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2485f5cf-9c01-4c2c-aae9-8e3025caf222 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:30.650478 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2485f5cf-9c01-4c2c-aae9-8e3025caf222 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091066 Oct 11 12:08:30.651202 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 367/723] 10.222.0.59 () {58 vars in 1275 bytes} [Tue Oct 11 12:08:30 2022] GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 12:08:30.677554 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-9c15ffe7-0b46-4116-a30b-3965a6fb123c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Flavor limits 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 12:08:30.678113 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-9c15ffe7-0b46-4116-a30b-3965a6fb123c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Image limits 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 12:08:30.678580 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-9c15ffe7-0b46-4116-a30b-3965a6fb123c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Flavor pref 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 12:08:30.679020 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-9c15ffe7-0b46-4116-a30b-3965a6fb123c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Image pref 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 12:08:30.679420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-9c15ffe7-0b46-4116-a30b-3965a6fb123c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 12:08:30.688786 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9c15ffe7-0b46-4116-a30b-3965a6fb123c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:30.689265 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9c15ffe7-0b46-4116-a30b-3965a6fb123c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:30.689690 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9c15ffe7-0b46-4116-a30b-3965a6fb123c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:30.690406 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9c15ffe7-0b46-4116-a30b-3965a6fb123c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:30.690871 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9c15ffe7-0b46-4116-a30b-3965a6fb123c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:30.691291 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9c15ffe7-0b46-4116-a30b-3965a6fb123c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:30.708731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-9c15ffe7-0b46-4116-a30b-3965a6fb123c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Getting quotas for project 9a7beb3a9d2b4ee9ba323d5bccc618c2. Resources: {'ram', 'instances', 'cores'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 12:08:30.713064 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-9c15ffe7-0b46-4116-a30b-3965a6fb123c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Getting quotas for user a78e40d4eb554ca49eeec530a7adf428 and project 9a7beb3a9d2b4ee9ba323d5bccc618c2. Resources: {'ram', 'instances', 'cores'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 12:08:30.724817 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-9c15ffe7-0b46-4116-a30b-3965a6fb123c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Going to run 1 instances... {{(pid=118994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 12:08:30.727249 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-9c15ffe7-0b46-4116-a30b-3965a6fb123c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: 685030b8-7128-4366-a241-55617cbe5b1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09bcc8f8-a32f-4ec8-9ab2-a98964ad6a01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 12:08:30.776072 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-9c15ffe7-0b46-4116-a30b-3965a6fb123c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.619489 Oct 11 12:08:30.776642 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 357/724] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Oct 11 12:08:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 12:08:30.788342 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-38071364-dd1f-4b49-904a-2783d475c415 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:30.789210 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-38071364-dd1f-4b49-904a-2783d475c415 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: 685030b8-7128-4366-a241-55617cbe5b1f] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:30.861001 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-38071364-dd1f-4b49-904a-2783d475c415 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:08:30.870082 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-38071364-dd1f-4b49-904a-2783d475c415 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f" status: 200 len: 1236 microversion: 2.1 time: 0.084947 Oct 11 12:08:30.870548 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 368/725] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:08:30 2022] GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f => generated 1236 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:08:31.893738 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-7f84034b-a698-49ac-ab57-b0f402fec7c2 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:31.894504 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-7f84034b-a698-49ac-ab57-b0f402fec7c2 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: 685030b8-7128-4366-a241-55617cbe5b1f] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:31.903188 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7f84034b-a698-49ac-ab57-b0f402fec7c2 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:31.904015 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7f84034b-a698-49ac-ab57-b0f402fec7c2 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:31.904455 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7f84034b-a698-49ac-ab57-b0f402fec7c2 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:31.905185 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7f84034b-a698-49ac-ab57-b0f402fec7c2 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:31.905638 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7f84034b-a698-49ac-ab57-b0f402fec7c2 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:31.906053 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7f84034b-a698-49ac-ab57-b0f402fec7c2 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:31.974258 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-12812551-842b-4c1f-bd3d-722394d279ce req-5cf317bf-eabb-45b0-9454-5fa500e152d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5902c505-fc30-4239-b20e-2b5b1f213c38", "tag": "b29d9996-d1dc-46fb-aba2-3d0f27d4ffba"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:08:31.985562 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-12812551-842b-4c1f-bd3d-722394d279ce req-5cf317bf-eabb-45b0-9454-5fa500e152d2 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:31.986041 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-12812551-842b-4c1f-bd3d-722394d279ce req-5cf317bf-eabb-45b0-9454-5fa500e152d2 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:31.986464 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-12812551-842b-4c1f-bd3d-722394d279ce req-5cf317bf-eabb-45b0-9454-5fa500e152d2 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:32.000731 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-12812551-842b-4c1f-bd3d-722394d279ce req-5cf317bf-eabb-45b0-9454-5fa500e152d2 service nova] Creating event network-changed:b29d9996-d1dc-46fb-aba2-3d0f27d4ffba for instance 5902c505-fc30-4239-b20e-2b5b1f213c38 on hv-cinder-82099 Oct 11 12:08:32.006355 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-12812551-842b-4c1f-bd3d-722394d279ce req-5cf317bf-eabb-45b0-9454-5fa500e152d2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035899 Oct 11 12:08:32.007705 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 369/726] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 12:08:32.018121 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-7f84034b-a698-49ac-ab57-b0f402fec7c2 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:08:32.027215 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-7f84034b-a698-49ac-ab57-b0f402fec7c2 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f" status: 200 len: 1288 microversion: 2.1 time: 0.138348 Oct 11 12:08:32.027807 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 358/727] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:08:31 2022] GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f => generated 1288 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:08:33.053240 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8b8f18e5-f8cc-4269-a6ac-2084da331e42 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:33.054626 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8b8f18e5-f8cc-4269-a6ac-2084da331e42 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: 685030b8-7128-4366-a241-55617cbe5b1f] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:33.061778 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8b8f18e5-f8cc-4269-a6ac-2084da331e42 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:33.062267 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8b8f18e5-f8cc-4269-a6ac-2084da331e42 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:33.062731 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8b8f18e5-f8cc-4269-a6ac-2084da331e42 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:33.063431 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8b8f18e5-f8cc-4269-a6ac-2084da331e42 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:33.064044 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8b8f18e5-f8cc-4269-a6ac-2084da331e42 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:33.064617 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8b8f18e5-f8cc-4269-a6ac-2084da331e42 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:33.145109 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8b8f18e5-f8cc-4269-a6ac-2084da331e42 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:08:33.154790 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8b8f18e5-f8cc-4269-a6ac-2084da331e42 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f" status: 200 len: 1294 microversion: 2.1 time: 0.106520 Oct 11 12:08:33.155481 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 370/728] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:08:33 2022] GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f => generated 1294 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:08:34.057269 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-f97fe43d-d986-4f78-a652-4ea673e1a76d req-7ed2b492-fbd5-42c9-8454-51620bb41c6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "685030b8-7128-4366-a241-55617cbe5b1f", "tag": "46ec508e-a8e6-4d19-a304-ae2d3a333e4e"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:08:34.068492 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-f97fe43d-d986-4f78-a652-4ea673e1a76d req-7ed2b492-fbd5-42c9-8454-51620bb41c6f service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:34.069013 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-f97fe43d-d986-4f78-a652-4ea673e1a76d req-7ed2b492-fbd5-42c9-8454-51620bb41c6f service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:34.069478 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-f97fe43d-d986-4f78-a652-4ea673e1a76d req-7ed2b492-fbd5-42c9-8454-51620bb41c6f service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:34.081370 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-f97fe43d-d986-4f78-a652-4ea673e1a76d req-7ed2b492-fbd5-42c9-8454-51620bb41c6f service nova] Creating event network-changed:46ec508e-a8e6-4d19-a304-ae2d3a333e4e for instance 685030b8-7128-4366-a241-55617cbe5b1f on hv-cinder-82099 Oct 11 12:08:34.086209 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-f97fe43d-d986-4f78-a652-4ea673e1a76d req-7ed2b492-fbd5-42c9-8454-51620bb41c6f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033174 Oct 11 12:08:34.086839 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 359/729] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:08:34.177599 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d2de8c7f-4b3b-4c7f-a9f8-ac554fe51de0 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:34.178227 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d2de8c7f-4b3b-4c7f-a9f8-ac554fe51de0 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: 685030b8-7128-4366-a241-55617cbe5b1f] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:34.185142 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d2de8c7f-4b3b-4c7f-a9f8-ac554fe51de0 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:34.185654 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d2de8c7f-4b3b-4c7f-a9f8-ac554fe51de0 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:34.186050 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d2de8c7f-4b3b-4c7f-a9f8-ac554fe51de0 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:34.186778 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d2de8c7f-4b3b-4c7f-a9f8-ac554fe51de0 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:34.187224 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d2de8c7f-4b3b-4c7f-a9f8-ac554fe51de0 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:34.187639 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d2de8c7f-4b3b-4c7f-a9f8-ac554fe51de0 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:34.426994 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d2de8c7f-4b3b-4c7f-a9f8-ac554fe51de0 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:08:34.435021 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d2de8c7f-4b3b-4c7f-a9f8-ac554fe51de0 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f" status: 200 len: 1361 microversion: 2.1 time: 0.261299 Oct 11 12:08:34.435588 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 371/730] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:08:34 2022] GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f => generated 1361 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:08:35.463037 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-77abcb9e-beb4-4ae9-9edd-d4650c1caac7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:35.463647 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-77abcb9e-beb4-4ae9-9edd-d4650c1caac7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: 685030b8-7128-4366-a241-55617cbe5b1f] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:35.472723 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-77abcb9e-beb4-4ae9-9edd-d4650c1caac7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:35.473311 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-77abcb9e-beb4-4ae9-9edd-d4650c1caac7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:35.473918 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-77abcb9e-beb4-4ae9-9edd-d4650c1caac7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:35.474940 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-77abcb9e-beb4-4ae9-9edd-d4650c1caac7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:35.475544 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-77abcb9e-beb4-4ae9-9edd-d4650c1caac7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:35.475963 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-77abcb9e-beb4-4ae9-9edd-d4650c1caac7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:35.611809 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-77abcb9e-beb4-4ae9-9edd-d4650c1caac7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:08:35.620373 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-77abcb9e-beb4-4ae9-9edd-d4650c1caac7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f" status: 200 len: 1361 microversion: 2.1 time: 0.164581 Oct 11 12:08:35.620951 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 360/731] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:08:35 2022] GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:08:36.644819 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-711f77b4-be0c-4216-96f2-e7cc21c8e1b2 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:36.645396 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-711f77b4-be0c-4216-96f2-e7cc21c8e1b2 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: 685030b8-7128-4366-a241-55617cbe5b1f] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:36.653707 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-711f77b4-be0c-4216-96f2-e7cc21c8e1b2 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:36.654265 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-711f77b4-be0c-4216-96f2-e7cc21c8e1b2 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:36.654902 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-711f77b4-be0c-4216-96f2-e7cc21c8e1b2 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:36.655619 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-711f77b4-be0c-4216-96f2-e7cc21c8e1b2 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:36.656148 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-711f77b4-be0c-4216-96f2-e7cc21c8e1b2 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:36.656683 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-711f77b4-be0c-4216-96f2-e7cc21c8e1b2 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:36.796866 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-711f77b4-be0c-4216-96f2-e7cc21c8e1b2 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:08:36.808527 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-711f77b4-be0c-4216-96f2-e7cc21c8e1b2 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f" status: 200 len: 1361 microversion: 2.1 time: 0.168874 Oct 11 12:08:36.809331 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 372/732] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:08:36 2022] GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f => generated 1361 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:08:37.836812 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-ba8b38bf-8197-4bed-8e03-d162d4a348aa tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:37.837419 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-ba8b38bf-8197-4bed-8e03-d162d4a348aa tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: 685030b8-7128-4366-a241-55617cbe5b1f] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:37.844519 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ba8b38bf-8197-4bed-8e03-d162d4a348aa tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:37.845020 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ba8b38bf-8197-4bed-8e03-d162d4a348aa tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:37.845485 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ba8b38bf-8197-4bed-8e03-d162d4a348aa tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:37.846183 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ba8b38bf-8197-4bed-8e03-d162d4a348aa tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:37.846633 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ba8b38bf-8197-4bed-8e03-d162d4a348aa tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:37.847077 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ba8b38bf-8197-4bed-8e03-d162d4a348aa tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:38.000613 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-ba8b38bf-8197-4bed-8e03-d162d4a348aa tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:08:38.009099 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-ba8b38bf-8197-4bed-8e03-d162d4a348aa tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f" status: 200 len: 1361 microversion: 2.1 time: 0.176131 Oct 11 12:08:38.009669 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 361/733] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:08:37 2022] GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f => generated 1361 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:08:39.033559 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-84159dba-cf4f-4c48-94d6-4c6606131efc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:39.034141 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-84159dba-cf4f-4c48-94d6-4c6606131efc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: 685030b8-7128-4366-a241-55617cbe5b1f] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:39.036668 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=66,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:39.042797 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-84159dba-cf4f-4c48-94d6-4c6606131efc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:39.043301 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-84159dba-cf4f-4c48-94d6-4c6606131efc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:39.043717 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-84159dba-cf4f-4c48-94d6-4c6606131efc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:39.044453 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-84159dba-cf4f-4c48-94d6-4c6606131efc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:39.044895 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-84159dba-cf4f-4c48-94d6-4c6606131efc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:39.045315 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-84159dba-cf4f-4c48-94d6-4c6606131efc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:39.192914 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-84159dba-cf4f-4c48-94d6-4c6606131efc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:08:39.201105 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-84159dba-cf4f-4c48-94d6-4c6606131efc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f" status: 200 len: 1361 microversion: 2.1 time: 0.171524 Oct 11 12:08:39.201700 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 373/734] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:08:39 2022] GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:08:39.418158 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-f9d835a7-9172-4825-92cf-dfd2ab70fa54 req-1763dca7-9920-4e1a-9a95-9c151c5502da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "685030b8-7128-4366-a241-55617cbe5b1f", "name": "network-vif-plugged", "status": "completed", "tag": "46ec508e-a8e6-4d19-a304-ae2d3a333e4e"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:08:39.423714 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=5,nova_api:DELETE=1 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:39.429867 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-f9d835a7-9172-4825-92cf-dfd2ab70fa54 req-1763dca7-9920-4e1a-9a95-9c151c5502da service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:39.430337 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-f9d835a7-9172-4825-92cf-dfd2ab70fa54 req-1763dca7-9920-4e1a-9a95-9c151c5502da service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:39.430783 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-f9d835a7-9172-4825-92cf-dfd2ab70fa54 req-1763dca7-9920-4e1a-9a95-9c151c5502da service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:39.444073 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-f9d835a7-9172-4825-92cf-dfd2ab70fa54 req-1763dca7-9920-4e1a-9a95-9c151c5502da service nova] Creating event network-vif-plugged:46ec508e-a8e6-4d19-a304-ae2d3a333e4e for instance 685030b8-7128-4366-a241-55617cbe5b1f on hv-cinder-82099 Oct 11 12:08:39.448950 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-f9d835a7-9172-4825-92cf-dfd2ab70fa54 req-1763dca7-9920-4e1a-9a95-9c151c5502da service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034580 Oct 11 12:08:39.449555 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 362/735] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:08:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:08:40.228104 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b6190b4c-5846-4455-9baf-0d90d654edad tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:40.228842 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-b6190b4c-5846-4455-9baf-0d90d654edad tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: 685030b8-7128-4366-a241-55617cbe5b1f] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:40.236361 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b6190b4c-5846-4455-9baf-0d90d654edad tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:40.236847 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b6190b4c-5846-4455-9baf-0d90d654edad tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:40.237276 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b6190b4c-5846-4455-9baf-0d90d654edad tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:40.238002 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b6190b4c-5846-4455-9baf-0d90d654edad tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:40.238446 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b6190b4c-5846-4455-9baf-0d90d654edad tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:40.238918 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b6190b4c-5846-4455-9baf-0d90d654edad tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:40.377849 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-b6190b4c-5846-4455-9baf-0d90d654edad tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:08:40.385960 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b6190b4c-5846-4455-9baf-0d90d654edad tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f" status: 200 len: 1361 microversion: 2.1 time: 0.163295 Oct 11 12:08:40.386550 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 374/736] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:08:40 2022] GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f => generated 1361 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:08:41.409788 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell0:SELECT=2 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:41.410595 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell0:SELECT=10 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:41.415875 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-7b5a0e26-d6e5-4de5-9101-2025a75227b6 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:41.416563 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-7b5a0e26-d6e5-4de5-9101-2025a75227b6 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: 685030b8-7128-4366-a241-55617cbe5b1f] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:41.426798 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7b5a0e26-d6e5-4de5-9101-2025a75227b6 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:41.427291 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7b5a0e26-d6e5-4de5-9101-2025a75227b6 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:41.427846 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7b5a0e26-d6e5-4de5-9101-2025a75227b6 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:41.428525 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7b5a0e26-d6e5-4de5-9101-2025a75227b6 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:41.429884 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7b5a0e26-d6e5-4de5-9101-2025a75227b6 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:41.429884 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7b5a0e26-d6e5-4de5-9101-2025a75227b6 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:41.566997 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-7b5a0e26-d6e5-4de5-9101-2025a75227b6 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:08:41.575560 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-7b5a0e26-d6e5-4de5-9101-2025a75227b6 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f" status: 200 len: 1547 microversion: 2.1 time: 0.167919 Oct 11 12:08:41.576196 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 363/737] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:08:41 2022] GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f => generated 1547 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:08:41.599562 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ef20b9de-43c7-4e95-9bbe-cd0d5a84396b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:08:41.600226 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ef20b9de-43c7-4e95-9bbe-cd0d5a84396b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: 685030b8-7128-4366-a241-55617cbe5b1f] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:08:41.602203 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=2 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:08:41.608373 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ef20b9de-43c7-4e95-9bbe-cd0d5a84396b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:41.609081 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ef20b9de-43c7-4e95-9bbe-cd0d5a84396b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:41.609772 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ef20b9de-43c7-4e95-9bbe-cd0d5a84396b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:41.610851 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ef20b9de-43c7-4e95-9bbe-cd0d5a84396b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:41.611524 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ef20b9de-43c7-4e95-9bbe-cd0d5a84396b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:41.612167 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ef20b9de-43c7-4e95-9bbe-cd0d5a84396b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:41.697520 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ef20b9de-43c7-4e95-9bbe-cd0d5a84396b tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102532 Oct 11 12:08:41.698174 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 375/738] 10.222.0.59 () {58 vars in 1275 bytes} [Tue Oct 11 12:08:41 2022] GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f/os-interface => generated 284 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:08:42.905382 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-267d7484-c53d-4c5f-8388-55594cbcae84 req-6fb88678-c8b3-4e69-b607-8a68b9b8ad47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "685030b8-7128-4366-a241-55617cbe5b1f", "tag": "46ec508e-a8e6-4d19-a304-ae2d3a333e4e"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:08:42.915668 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-267d7484-c53d-4c5f-8388-55594cbcae84 req-6fb88678-c8b3-4e69-b607-8a68b9b8ad47 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:08:42.916208 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-267d7484-c53d-4c5f-8388-55594cbcae84 req-6fb88678-c8b3-4e69-b607-8a68b9b8ad47 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:08:42.916697 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-267d7484-c53d-4c5f-8388-55594cbcae84 req-6fb88678-c8b3-4e69-b607-8a68b9b8ad47 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:08:42.928265 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-267d7484-c53d-4c5f-8388-55594cbcae84 req-6fb88678-c8b3-4e69-b607-8a68b9b8ad47 service nova] Creating event network-changed:46ec508e-a8e6-4d19-a304-ae2d3a333e4e for instance 685030b8-7128-4366-a241-55617cbe5b1f on hv-cinder-82099 Oct 11 12:08:42.933586 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-267d7484-c53d-4c5f-8388-55594cbcae84 req-6fb88678-c8b3-4e69-b607-8a68b9b8ad47 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032071 Oct 11 12:08:42.934364 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 364/739] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:09:28.013133 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=5 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:09:28.014323 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=44 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:09:28.020363 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e55ff273-f282-4824-84f6-dfd826355ca4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:09:28.020984 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e55ff273-f282-4824-84f6-dfd826355ca4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:09:28.028754 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e55ff273-f282-4824-84f6-dfd826355ca4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:28.029234 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e55ff273-f282-4824-84f6-dfd826355ca4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:28.029655 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e55ff273-f282-4824-84f6-dfd826355ca4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:28.030351 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e55ff273-f282-4824-84f6-dfd826355ca4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:28.030837 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e55ff273-f282-4824-84f6-dfd826355ca4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:28.031247 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e55ff273-f282-4824-84f6-dfd826355ca4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:28.056909 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e55ff273-f282-4824-84f6-dfd826355ca4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/ips" status: 200 len: 152 microversion: 2.20 time: 0.046198 Oct 11 12:09:28.057487 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 376/740] 10.222.0.59 () {60 vars in 1289 bytes} [Tue Oct 11 12:09:28 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/ips => generated 152 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 12:09:29.955374 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_api:SELECT=5 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:09:29.956157 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=59 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:09:29.960849 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-9b4e069a-5735-42a1-8dc1-1bc78c69bff8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:09:29.961515 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-9b4e069a-5735-42a1-8dc1-1bc78c69bff8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:09:29.969081 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9b4e069a-5735-42a1-8dc1-1bc78c69bff8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:29.969574 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9b4e069a-5735-42a1-8dc1-1bc78c69bff8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:29.970005 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9b4e069a-5735-42a1-8dc1-1bc78c69bff8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:29.970750 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9b4e069a-5735-42a1-8dc1-1bc78c69bff8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:29.971201 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9b4e069a-5735-42a1-8dc1-1bc78c69bff8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:29.971616 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9b4e069a-5735-42a1-8dc1-1bc78c69bff8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:29.999390 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.objects.instance [None req-9b4e069a-5735-42a1-8dc1-1bc78c69bff8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lazy-loading 'flavor' on Instance uuid 2f1f910a-6135-426a-97a7-570948cf922c {{(pid=118994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:09:30.204940 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-9b4e069a-5735-42a1-8dc1-1bc78c69bff8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "POST /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/action" status: 202 len: 0 microversion: 2.20 time: 0.251418 Oct 11 12:09:30.205632 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 365/741] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Oct 11 12:09:29 2022] POST /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 12:09:30.213990 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-72e92ffd-3d77-4676-bed2-1cdd6f198ef1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:09:30.214683 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-72e92ffd-3d77-4676-bed2-1cdd6f198ef1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:09:30.221215 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-72e92ffd-3d77-4676-bed2-1cdd6f198ef1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:30.221690 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-72e92ffd-3d77-4676-bed2-1cdd6f198ef1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:30.222391 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-72e92ffd-3d77-4676-bed2-1cdd6f198ef1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:30.223122 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-72e92ffd-3d77-4676-bed2-1cdd6f198ef1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:30.223552 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-72e92ffd-3d77-4676-bed2-1cdd6f198ef1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:30.224175 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-72e92ffd-3d77-4676-bed2-1cdd6f198ef1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:30.366668 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-72e92ffd-3d77-4676-bed2-1cdd6f198ef1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:30.375857 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-72e92ffd-3d77-4676-bed2-1cdd6f198ef1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:30.377288 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-72e92ffd-3d77-4676-bed2-1cdd6f198ef1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:30.378478 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-72e92ffd-3d77-4676-bed2-1cdd6f198ef1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1725 microversion: 2.20 time: 0.168474 Oct 11 12:09:30.379174 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 377/742] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:09:30 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 12:09:31.407755 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-4def40d2-8378-4002-b06f-fb534d8f8e12 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:09:31.408447 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-4def40d2-8378-4002-b06f-fb534d8f8e12 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:09:31.415669 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4def40d2-8378-4002-b06f-fb534d8f8e12 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:31.416239 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4def40d2-8378-4002-b06f-fb534d8f8e12 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:31.416676 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4def40d2-8378-4002-b06f-fb534d8f8e12 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:31.417776 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4def40d2-8378-4002-b06f-fb534d8f8e12 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:31.418219 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4def40d2-8378-4002-b06f-fb534d8f8e12 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:31.418660 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4def40d2-8378-4002-b06f-fb534d8f8e12 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:31.580474 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-4def40d2-8378-4002-b06f-fb534d8f8e12 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:31.589138 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-4def40d2-8378-4002-b06f-fb534d8f8e12 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:31.590568 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-4def40d2-8378-4002-b06f-fb534d8f8e12 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:31.591735 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-4def40d2-8378-4002-b06f-fb534d8f8e12 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1725 microversion: 2.20 time: 0.189554 Oct 11 12:09:31.592283 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 366/743] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:09:31 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:09:32.618386 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-65e6ec06-5224-47ae-85ad-07bc84b77fea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:09:32.619061 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-65e6ec06-5224-47ae-85ad-07bc84b77fea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:09:32.625862 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-65e6ec06-5224-47ae-85ad-07bc84b77fea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:32.626336 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-65e6ec06-5224-47ae-85ad-07bc84b77fea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:32.626814 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-65e6ec06-5224-47ae-85ad-07bc84b77fea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:32.627498 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-65e6ec06-5224-47ae-85ad-07bc84b77fea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:32.627958 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-65e6ec06-5224-47ae-85ad-07bc84b77fea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:32.628364 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-65e6ec06-5224-47ae-85ad-07bc84b77fea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:32.761490 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-65e6ec06-5224-47ae-85ad-07bc84b77fea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:32.771048 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-65e6ec06-5224-47ae-85ad-07bc84b77fea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:32.772478 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-65e6ec06-5224-47ae-85ad-07bc84b77fea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:32.773643 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-65e6ec06-5224-47ae-85ad-07bc84b77fea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1725 microversion: 2.20 time: 0.159379 Oct 11 12:09:32.774200 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 378/744] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:09:32 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:09:33.799432 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-40c74245-6801-481e-a34e-096e397eb839 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:09:33.800064 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-40c74245-6801-481e-a34e-096e397eb839 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:09:33.807075 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-40c74245-6801-481e-a34e-096e397eb839 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:33.807548 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-40c74245-6801-481e-a34e-096e397eb839 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:33.807968 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-40c74245-6801-481e-a34e-096e397eb839 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:33.808685 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-40c74245-6801-481e-a34e-096e397eb839 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:33.809127 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-40c74245-6801-481e-a34e-096e397eb839 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:33.809545 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-40c74245-6801-481e-a34e-096e397eb839 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:33.942406 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-40c74245-6801-481e-a34e-096e397eb839 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:33.951351 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-40c74245-6801-481e-a34e-096e397eb839 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:33.952820 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-40c74245-6801-481e-a34e-096e397eb839 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:33.954094 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-40c74245-6801-481e-a34e-096e397eb839 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1725 microversion: 2.20 time: 0.158676 Oct 11 12:09:33.954736 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 367/745] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:09:33 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:09:34.980685 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-11b0061c-b700-4573-952f-93fd7d8dbc81 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:09:34.981319 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-11b0061c-b700-4573-952f-93fd7d8dbc81 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:09:34.988318 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-11b0061c-b700-4573-952f-93fd7d8dbc81 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:34.988894 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-11b0061c-b700-4573-952f-93fd7d8dbc81 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:34.989328 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-11b0061c-b700-4573-952f-93fd7d8dbc81 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:34.990031 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-11b0061c-b700-4573-952f-93fd7d8dbc81 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:34.990484 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-11b0061c-b700-4573-952f-93fd7d8dbc81 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:34.990946 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-11b0061c-b700-4573-952f-93fd7d8dbc81 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:35.126975 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-11b0061c-b700-4573-952f-93fd7d8dbc81 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:35.136813 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-11b0061c-b700-4573-952f-93fd7d8dbc81 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:35.138268 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-11b0061c-b700-4573-952f-93fd7d8dbc81 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:35.139501 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-11b0061c-b700-4573-952f-93fd7d8dbc81 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1725 microversion: 2.20 time: 0.162945 Oct 11 12:09:35.140123 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 379/746] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:09:34 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:09:36.166654 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-eedd1f25-cb39-45be-bbf7-92f3849e43f8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:09:36.167236 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-eedd1f25-cb39-45be-bbf7-92f3849e43f8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:09:36.173936 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eedd1f25-cb39-45be-bbf7-92f3849e43f8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:36.174409 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eedd1f25-cb39-45be-bbf7-92f3849e43f8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:36.174859 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eedd1f25-cb39-45be-bbf7-92f3849e43f8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:36.175549 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eedd1f25-cb39-45be-bbf7-92f3849e43f8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:36.175992 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eedd1f25-cb39-45be-bbf7-92f3849e43f8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:36.176411 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eedd1f25-cb39-45be-bbf7-92f3849e43f8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:36.321719 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-eedd1f25-cb39-45be-bbf7-92f3849e43f8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:36.330853 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-eedd1f25-cb39-45be-bbf7-92f3849e43f8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:36.332332 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-eedd1f25-cb39-45be-bbf7-92f3849e43f8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:36.333498 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-eedd1f25-cb39-45be-bbf7-92f3849e43f8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1725 microversion: 2.20 time: 0.170872 Oct 11 12:09:36.334093 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 368/747] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:09:36 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:09:37.359444 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-1a4f73c4-141f-40c6-8e28-ca8bee5c2df2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:09:37.360077 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-1a4f73c4-141f-40c6-8e28-ca8bee5c2df2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:09:37.367197 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1a4f73c4-141f-40c6-8e28-ca8bee5c2df2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:37.367676 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1a4f73c4-141f-40c6-8e28-ca8bee5c2df2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:37.368113 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1a4f73c4-141f-40c6-8e28-ca8bee5c2df2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:37.368964 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1a4f73c4-141f-40c6-8e28-ca8bee5c2df2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:37.369414 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1a4f73c4-141f-40c6-8e28-ca8bee5c2df2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:37.369833 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1a4f73c4-141f-40c6-8e28-ca8bee5c2df2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:37.507542 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-1a4f73c4-141f-40c6-8e28-ca8bee5c2df2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:37.517085 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-1a4f73c4-141f-40c6-8e28-ca8bee5c2df2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:37.518508 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-1a4f73c4-141f-40c6-8e28-ca8bee5c2df2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:37.519675 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-1a4f73c4-141f-40c6-8e28-ca8bee5c2df2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1725 microversion: 2.20 time: 0.164228 Oct 11 12:09:37.520358 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 380/748] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:09:37 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:09:38.545491 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-b1c4d404-c386-48d2-9504-d58e3aa5dd63 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:09:38.546093 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-b1c4d404-c386-48d2-9504-d58e3aa5dd63 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:09:38.553642 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b1c4d404-c386-48d2-9504-d58e3aa5dd63 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:38.554145 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b1c4d404-c386-48d2-9504-d58e3aa5dd63 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:38.554700 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b1c4d404-c386-48d2-9504-d58e3aa5dd63 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:38.555465 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b1c4d404-c386-48d2-9504-d58e3aa5dd63 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:38.555967 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b1c4d404-c386-48d2-9504-d58e3aa5dd63 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:38.556487 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b1c4d404-c386-48d2-9504-d58e3aa5dd63 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:38.694072 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-b1c4d404-c386-48d2-9504-d58e3aa5dd63 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:38.702586 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-b1c4d404-c386-48d2-9504-d58e3aa5dd63 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:38.704023 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-b1c4d404-c386-48d2-9504-d58e3aa5dd63 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:38.705175 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-b1c4d404-c386-48d2-9504-d58e3aa5dd63 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1725 microversion: 2.20 time: 0.164242 Oct 11 12:09:38.705742 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 369/749] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:09:38 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:09:39.736013 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2fe46ee2-2f50-44fd-8491-35f968f2b0c4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:09:39.736781 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2fe46ee2-2f50-44fd-8491-35f968f2b0c4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:09:39.746709 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2fe46ee2-2f50-44fd-8491-35f968f2b0c4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:39.747364 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2fe46ee2-2f50-44fd-8491-35f968f2b0c4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:39.747918 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2fe46ee2-2f50-44fd-8491-35f968f2b0c4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:39.748857 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2fe46ee2-2f50-44fd-8491-35f968f2b0c4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:39.749369 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2fe46ee2-2f50-44fd-8491-35f968f2b0c4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:39.749925 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2fe46ee2-2f50-44fd-8491-35f968f2b0c4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:39.895529 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2fe46ee2-2f50-44fd-8491-35f968f2b0c4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:39.904091 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2fe46ee2-2f50-44fd-8491-35f968f2b0c4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:39.905501 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2fe46ee2-2f50-44fd-8491-35f968f2b0c4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:39.906664 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2fe46ee2-2f50-44fd-8491-35f968f2b0c4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1725 microversion: 2.20 time: 0.176524 Oct 11 12:09:39.907218 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 381/750] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:09:39 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:09:40.933856 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-72f2116e-3002-4d3c-87c0-605348a02424 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:09:40.934455 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-72f2116e-3002-4d3c-87c0-605348a02424 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:09:40.941630 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-72f2116e-3002-4d3c-87c0-605348a02424 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:40.942128 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-72f2116e-3002-4d3c-87c0-605348a02424 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:40.942548 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-72f2116e-3002-4d3c-87c0-605348a02424 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:40.943261 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-72f2116e-3002-4d3c-87c0-605348a02424 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:40.943700 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-72f2116e-3002-4d3c-87c0-605348a02424 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:40.944106 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-72f2116e-3002-4d3c-87c0-605348a02424 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:41.096655 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-72f2116e-3002-4d3c-87c0-605348a02424 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:41.105545 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-72f2116e-3002-4d3c-87c0-605348a02424 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:41.106966 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-72f2116e-3002-4d3c-87c0-605348a02424 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:41.108114 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-72f2116e-3002-4d3c-87c0-605348a02424 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1725 microversion: 2.20 time: 0.179808 Oct 11 12:09:41.108669 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 370/751] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:09:40 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1725 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:09:42.133533 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-fa2bab0f-f817-4139-b4af-f8c69b339d3c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:09:42.134234 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-fa2bab0f-f817-4139-b4af-f8c69b339d3c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:09:42.141448 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fa2bab0f-f817-4139-b4af-f8c69b339d3c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:42.141925 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fa2bab0f-f817-4139-b4af-f8c69b339d3c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:42.142356 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fa2bab0f-f817-4139-b4af-f8c69b339d3c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:42.143088 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fa2bab0f-f817-4139-b4af-f8c69b339d3c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:42.143532 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fa2bab0f-f817-4139-b4af-f8c69b339d3c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:42.143953 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fa2bab0f-f817-4139-b4af-f8c69b339d3c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:42.285645 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-fa2bab0f-f817-4139-b4af-f8c69b339d3c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:42.294159 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-fa2bab0f-f817-4139-b4af-f8c69b339d3c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:42.295624 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-fa2bab0f-f817-4139-b4af-f8c69b339d3c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:42.296782 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-fa2bab0f-f817-4139-b4af-f8c69b339d3c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1746 microversion: 2.20 time: 0.167278 Oct 11 12:09:42.297342 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 382/752] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:09:42 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1746 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:09:43.322803 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-d0adf9e1-9607-40f5-939d-983afd744909 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:09:43.324231 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-d0adf9e1-9607-40f5-939d-983afd744909 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:09:43.331435 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d0adf9e1-9607-40f5-939d-983afd744909 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:43.331914 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d0adf9e1-9607-40f5-939d-983afd744909 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:43.332497 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d0adf9e1-9607-40f5-939d-983afd744909 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:43.333246 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d0adf9e1-9607-40f5-939d-983afd744909 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:43.333721 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d0adf9e1-9607-40f5-939d-983afd744909 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:43.334138 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d0adf9e1-9607-40f5-939d-983afd744909 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:43.472025 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-d0adf9e1-9607-40f5-939d-983afd744909 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:43.481006 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-d0adf9e1-9607-40f5-939d-983afd744909 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:43.482435 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-d0adf9e1-9607-40f5-939d-983afd744909 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:43.483651 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-d0adf9e1-9607-40f5-939d-983afd744909 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1746 microversion: 2.20 time: 0.165236 Oct 11 12:09:43.484224 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 371/753] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:09:43 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1746 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:09:44.509359 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-111a35b3-e43a-45e7-8a5f-c048f1994555 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:09:44.510016 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-111a35b3-e43a-45e7-8a5f-c048f1994555 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:09:44.517407 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-111a35b3-e43a-45e7-8a5f-c048f1994555 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:44.517885 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-111a35b3-e43a-45e7-8a5f-c048f1994555 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:44.518307 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-111a35b3-e43a-45e7-8a5f-c048f1994555 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:44.519039 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-111a35b3-e43a-45e7-8a5f-c048f1994555 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:44.519480 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-111a35b3-e43a-45e7-8a5f-c048f1994555 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:44.519868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-111a35b3-e43a-45e7-8a5f-c048f1994555 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:44.654543 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-111a35b3-e43a-45e7-8a5f-c048f1994555 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:44.663564 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-111a35b3-e43a-45e7-8a5f-c048f1994555 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:44.665284 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-111a35b3-e43a-45e7-8a5f-c048f1994555 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:44.666448 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-111a35b3-e43a-45e7-8a5f-c048f1994555 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1746 microversion: 2.20 time: 0.161183 Oct 11 12:09:44.667083 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 383/754] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:09:44 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1746 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:09:45.692061 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-095e6e65-1f20-4400-b371-3fed8dd8fba6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:09:45.692671 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-095e6e65-1f20-4400-b371-3fed8dd8fba6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:09:45.699853 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-095e6e65-1f20-4400-b371-3fed8dd8fba6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:45.700336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-095e6e65-1f20-4400-b371-3fed8dd8fba6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:45.700759 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-095e6e65-1f20-4400-b371-3fed8dd8fba6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:45.701466 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-095e6e65-1f20-4400-b371-3fed8dd8fba6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:45.701913 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-095e6e65-1f20-4400-b371-3fed8dd8fba6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:45.702326 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-095e6e65-1f20-4400-b371-3fed8dd8fba6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:45.839607 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-095e6e65-1f20-4400-b371-3fed8dd8fba6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:45.848078 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-095e6e65-1f20-4400-b371-3fed8dd8fba6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:45.849563 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-095e6e65-1f20-4400-b371-3fed8dd8fba6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:45.850777 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-095e6e65-1f20-4400-b371-3fed8dd8fba6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1746 microversion: 2.20 time: 0.162812 Oct 11 12:09:45.851718 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 372/755] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:09:45 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:09:46.877130 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-fedb8fd6-7e6c-45e9-9f71-3a1c40a331aa tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:09:46.877816 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-fedb8fd6-7e6c-45e9-9f71-3a1c40a331aa tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:09:46.885023 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fedb8fd6-7e6c-45e9-9f71-3a1c40a331aa tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:46.885513 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fedb8fd6-7e6c-45e9-9f71-3a1c40a331aa tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:46.885939 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fedb8fd6-7e6c-45e9-9f71-3a1c40a331aa tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:46.886658 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fedb8fd6-7e6c-45e9-9f71-3a1c40a331aa tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:46.887124 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fedb8fd6-7e6c-45e9-9f71-3a1c40a331aa tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:46.887592 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fedb8fd6-7e6c-45e9-9f71-3a1c40a331aa tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:47.028746 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-fedb8fd6-7e6c-45e9-9f71-3a1c40a331aa tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:47.041658 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-fedb8fd6-7e6c-45e9-9f71-3a1c40a331aa tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:47.044022 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-fedb8fd6-7e6c-45e9-9f71-3a1c40a331aa tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:47.045518 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-fedb8fd6-7e6c-45e9-9f71-3a1c40a331aa tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1746 microversion: 2.20 time: 0.172557 Oct 11 12:09:47.046051 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 384/756] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:09:46 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1746 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:09:47.783795 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-5a57273f-8fea-44d5-9848-eef2ce4145ea req-238ebe89-23a9-4fca-bf0f-0234e03746f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f1f910a-6135-426a-97a7-570948cf922c", "name": "network-vif-plugged", "status": "completed", "tag": "4781df9c-1cb1-4999-a0a2-4e1d4e77d276"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:09:47.794318 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-5a57273f-8fea-44d5-9848-eef2ce4145ea req-238ebe89-23a9-4fca-bf0f-0234e03746f7 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:47.794862 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-5a57273f-8fea-44d5-9848-eef2ce4145ea req-238ebe89-23a9-4fca-bf0f-0234e03746f7 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:47.795324 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-5a57273f-8fea-44d5-9848-eef2ce4145ea req-238ebe89-23a9-4fca-bf0f-0234e03746f7 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:47.807064 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-5a57273f-8fea-44d5-9848-eef2ce4145ea req-238ebe89-23a9-4fca-bf0f-0234e03746f7 service nova] Creating event network-vif-plugged:4781df9c-1cb1-4999-a0a2-4e1d4e77d276 for instance 2f1f910a-6135-426a-97a7-570948cf922c on hv-cinder-82099 Oct 11 12:09:47.812269 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-5a57273f-8fea-44d5-9848-eef2ce4145ea req-238ebe89-23a9-4fca-bf0f-0234e03746f7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032327 Oct 11 12:09:47.813028 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 373/757] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:09:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:09:48.071821 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e1058c13-e180-4a43-90f1-41d790d218db tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:09:48.072466 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e1058c13-e180-4a43-90f1-41d790d218db tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:09:48.080224 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e1058c13-e180-4a43-90f1-41d790d218db tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:48.080762 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e1058c13-e180-4a43-90f1-41d790d218db tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:48.081240 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e1058c13-e180-4a43-90f1-41d790d218db tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:48.082002 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e1058c13-e180-4a43-90f1-41d790d218db tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:48.082497 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e1058c13-e180-4a43-90f1-41d790d218db tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:48.083004 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e1058c13-e180-4a43-90f1-41d790d218db tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:48.218355 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e1058c13-e180-4a43-90f1-41d790d218db tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:48.227349 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e1058c13-e180-4a43-90f1-41d790d218db tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:48.228782 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e1058c13-e180-4a43-90f1-41d790d218db tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:48.229954 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e1058c13-e180-4a43-90f1-41d790d218db tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1746 microversion: 2.20 time: 0.162579 Oct 11 12:09:48.230823 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 385/758] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:09:48 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:09:49.256468 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-2ec231e0-c361-4bf6-aff3-a0663188f687 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:09:49.257071 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-2ec231e0-c361-4bf6-aff3-a0663188f687 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:09:49.264250 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2ec231e0-c361-4bf6-aff3-a0663188f687 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:49.264746 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2ec231e0-c361-4bf6-aff3-a0663188f687 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:49.265591 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2ec231e0-c361-4bf6-aff3-a0663188f687 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:49.266284 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2ec231e0-c361-4bf6-aff3-a0663188f687 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:49.266759 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2ec231e0-c361-4bf6-aff3-a0663188f687 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:49.267172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2ec231e0-c361-4bf6-aff3-a0663188f687 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:49.404694 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-2ec231e0-c361-4bf6-aff3-a0663188f687 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:49.413206 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-2ec231e0-c361-4bf6-aff3-a0663188f687 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:49.414684 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-2ec231e0-c361-4bf6-aff3-a0663188f687 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:49.415858 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-2ec231e0-c361-4bf6-aff3-a0663188f687 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1741 microversion: 2.20 time: 0.163996 Oct 11 12:09:49.416418 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 374/759] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:09:49 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1741 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:09:50.444106 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-700efe2d-9a7d-4b6d-8b8d-46ee0d6572de tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:09:50.445063 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-700efe2d-9a7d-4b6d-8b8d-46ee0d6572de tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:09:50.451446 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-700efe2d-9a7d-4b6d-8b8d-46ee0d6572de tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:50.452215 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-700efe2d-9a7d-4b6d-8b8d-46ee0d6572de tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:50.452893 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-700efe2d-9a7d-4b6d-8b8d-46ee0d6572de tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:50.453821 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-700efe2d-9a7d-4b6d-8b8d-46ee0d6572de tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:50.454480 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-700efe2d-9a7d-4b6d-8b8d-46ee0d6572de tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:50.455136 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-700efe2d-9a7d-4b6d-8b8d-46ee0d6572de tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:50.598418 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-700efe2d-9a7d-4b6d-8b8d-46ee0d6572de tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:50.607521 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-700efe2d-9a7d-4b6d-8b8d-46ee0d6572de tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:50.609313 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-700efe2d-9a7d-4b6d-8b8d-46ee0d6572de tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:50.610801 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-700efe2d-9a7d-4b6d-8b8d-46ee0d6572de tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1741 microversion: 2.20 time: 0.171603 Oct 11 12:09:50.611444 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 386/760] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:09:50 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1741 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:09:51.636172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-728af548-cbb6-4f67-b7ff-79be2406cd16 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:09:51.636951 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-728af548-cbb6-4f67-b7ff-79be2406cd16 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:09:51.644905 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-728af548-cbb6-4f67-b7ff-79be2406cd16 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:51.646041 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-728af548-cbb6-4f67-b7ff-79be2406cd16 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:51.646480 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-728af548-cbb6-4f67-b7ff-79be2406cd16 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:51.647217 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-728af548-cbb6-4f67-b7ff-79be2406cd16 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:51.647708 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-728af548-cbb6-4f67-b7ff-79be2406cd16 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:51.648168 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-728af548-cbb6-4f67-b7ff-79be2406cd16 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:51.805785 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-728af548-cbb6-4f67-b7ff-79be2406cd16 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:51.814240 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-728af548-cbb6-4f67-b7ff-79be2406cd16 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:51.815697 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-728af548-cbb6-4f67-b7ff-79be2406cd16 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:51.816853 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-728af548-cbb6-4f67-b7ff-79be2406cd16 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1741 microversion: 2.20 time: 0.185129 Oct 11 12:09:51.817411 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 375/761] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:09:51 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1741 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:09:52.842830 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c371581b-e73c-42ae-a580-253aaaf3bb12 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:09:52.844201 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c371581b-e73c-42ae-a580-253aaaf3bb12 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:09:52.851160 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c371581b-e73c-42ae-a580-253aaaf3bb12 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:52.851664 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c371581b-e73c-42ae-a580-253aaaf3bb12 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:52.852091 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c371581b-e73c-42ae-a580-253aaaf3bb12 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:52.852794 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c371581b-e73c-42ae-a580-253aaaf3bb12 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:52.853240 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c371581b-e73c-42ae-a580-253aaaf3bb12 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:52.853674 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c371581b-e73c-42ae-a580-253aaaf3bb12 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:53.012055 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c371581b-e73c-42ae-a580-253aaaf3bb12 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:53.021301 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c371581b-e73c-42ae-a580-253aaaf3bb12 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:53.023192 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c371581b-e73c-42ae-a580-253aaaf3bb12 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:53.024671 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c371581b-e73c-42ae-a580-253aaaf3bb12 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1741 microversion: 2.20 time: 0.186075 Oct 11 12:09:53.041874 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 387/762] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:09:52 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1741 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:09:54.050784 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-89debeb2-fbb7-4c26-afee-9af8f8c811f1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:09:54.052165 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-89debeb2-fbb7-4c26-afee-9af8f8c811f1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:09:54.059519 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-89debeb2-fbb7-4c26-afee-9af8f8c811f1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:54.060094 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-89debeb2-fbb7-4c26-afee-9af8f8c811f1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:54.060584 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-89debeb2-fbb7-4c26-afee-9af8f8c811f1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:54.061550 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-89debeb2-fbb7-4c26-afee-9af8f8c811f1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:54.062180 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-89debeb2-fbb7-4c26-afee-9af8f8c811f1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:54.062826 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-89debeb2-fbb7-4c26-afee-9af8f8c811f1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:54.199104 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-89debeb2-fbb7-4c26-afee-9af8f8c811f1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:54.209243 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-89debeb2-fbb7-4c26-afee-9af8f8c811f1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:54.210708 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-89debeb2-fbb7-4c26-afee-9af8f8c811f1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:54.211902 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-89debeb2-fbb7-4c26-afee-9af8f8c811f1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1741 microversion: 2.20 time: 0.165307 Oct 11 12:09:54.212529 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 376/763] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:09:54 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1741 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:09:55.237680 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-325052ad-d124-49ba-ae4b-bd8a36dc0921 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:09:55.238244 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-325052ad-d124-49ba-ae4b-bd8a36dc0921 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:09:55.246034 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-325052ad-d124-49ba-ae4b-bd8a36dc0921 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:55.246488 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-325052ad-d124-49ba-ae4b-bd8a36dc0921 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:55.246934 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-325052ad-d124-49ba-ae4b-bd8a36dc0921 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:55.247619 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-325052ad-d124-49ba-ae4b-bd8a36dc0921 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:55.248058 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-325052ad-d124-49ba-ae4b-bd8a36dc0921 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:55.248497 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-325052ad-d124-49ba-ae4b-bd8a36dc0921 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:55.435547 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-325052ad-d124-49ba-ae4b-bd8a36dc0921 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:55.445042 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-325052ad-d124-49ba-ae4b-bd8a36dc0921 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:55.446469 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-325052ad-d124-49ba-ae4b-bd8a36dc0921 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:55.447661 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-325052ad-d124-49ba-ae4b-bd8a36dc0921 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1741 microversion: 2.20 time: 0.214499 Oct 11 12:09:55.448399 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 388/764] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:09:55 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1741 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:09:56.473169 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-dc4fd5c2-7eea-4ebd-87d0-27533663ac35 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:09:56.473761 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-dc4fd5c2-7eea-4ebd-87d0-27533663ac35 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:09:56.480722 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-dc4fd5c2-7eea-4ebd-87d0-27533663ac35 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:56.481208 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-dc4fd5c2-7eea-4ebd-87d0-27533663ac35 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:56.481649 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-dc4fd5c2-7eea-4ebd-87d0-27533663ac35 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:56.482379 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-dc4fd5c2-7eea-4ebd-87d0-27533663ac35 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:56.482863 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-dc4fd5c2-7eea-4ebd-87d0-27533663ac35 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:56.483296 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-dc4fd5c2-7eea-4ebd-87d0-27533663ac35 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:56.695652 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-dc4fd5c2-7eea-4ebd-87d0-27533663ac35 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:56.704562 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-dc4fd5c2-7eea-4ebd-87d0-27533663ac35 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:56.706010 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-dc4fd5c2-7eea-4ebd-87d0-27533663ac35 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:56.707207 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-dc4fd5c2-7eea-4ebd-87d0-27533663ac35 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1741 microversion: 2.20 time: 0.238056 Oct 11 12:09:56.707769 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 377/765] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:09:56 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1741 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:09:57.732616 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f6eb33c4-8860-488a-b36c-a696c26e7928 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:09:57.734791 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f6eb33c4-8860-488a-b36c-a696c26e7928 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:09:57.741763 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f6eb33c4-8860-488a-b36c-a696c26e7928 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:57.742250 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f6eb33c4-8860-488a-b36c-a696c26e7928 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:57.742842 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f6eb33c4-8860-488a-b36c-a696c26e7928 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:57.743952 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f6eb33c4-8860-488a-b36c-a696c26e7928 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:57.744571 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f6eb33c4-8860-488a-b36c-a696c26e7928 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:57.744995 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f6eb33c4-8860-488a-b36c-a696c26e7928 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:58.011917 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f6eb33c4-8860-488a-b36c-a696c26e7928 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:58.022954 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f6eb33c4-8860-488a-b36c-a696c26e7928 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:58.024396 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f6eb33c4-8860-488a-b36c-a696c26e7928 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:58.025847 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f6eb33c4-8860-488a-b36c-a696c26e7928 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1741 microversion: 2.20 time: 0.297473 Oct 11 12:09:58.026598 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 389/766] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:09:57 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1741 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:09:59.057497 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-3cb17c71-ad61-4311-8c4e-bbd56aa0d0ff tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:09:59.058103 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-3cb17c71-ad61-4311-8c4e-bbd56aa0d0ff tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:09:59.065353 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3cb17c71-ad61-4311-8c4e-bbd56aa0d0ff tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:59.065843 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3cb17c71-ad61-4311-8c4e-bbd56aa0d0ff tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:59.066268 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3cb17c71-ad61-4311-8c4e-bbd56aa0d0ff tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:59.067006 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3cb17c71-ad61-4311-8c4e-bbd56aa0d0ff tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:59.067454 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3cb17c71-ad61-4311-8c4e-bbd56aa0d0ff tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:59.068187 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3cb17c71-ad61-4311-8c4e-bbd56aa0d0ff tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:59.219300 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-3cb17c71-ad61-4311-8c4e-bbd56aa0d0ff tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:59.231253 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-3cb17c71-ad61-4311-8c4e-bbd56aa0d0ff tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:59.233008 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-3cb17c71-ad61-4311-8c4e-bbd56aa0d0ff tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:09:59.234275 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-3cb17c71-ad61-4311-8c4e-bbd56aa0d0ff tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1741 microversion: 2.20 time: 0.181504 Oct 11 12:09:59.235170 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 378/767] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:09:59 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1741 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:09:59.616171 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-499d2305-2b17-41cb-aed2-515be50ffef1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:09:59.617327 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-499d2305-2b17-41cb-aed2-515be50ffef1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:09:59.620286 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=29 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:09:59.625379 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-499d2305-2b17-41cb-aed2-515be50ffef1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:59.625951 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-499d2305-2b17-41cb-aed2-515be50ffef1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:59.626447 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-499d2305-2b17-41cb-aed2-515be50ffef1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:59.627215 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-499d2305-2b17-41cb-aed2-515be50ffef1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:09:59.627658 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-499d2305-2b17-41cb-aed2-515be50ffef1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:09:59.628248 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-499d2305-2b17-41cb-aed2-515be50ffef1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:09:59.632404 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=83 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:09:59.656961 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-499d2305-2b17-41cb-aed2-515be50ffef1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38/ips" status: 200 len: 149 microversion: 2.1 time: 0.044576 Oct 11 12:09:59.657540 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 390/768] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Oct 11 12:09:59 2022] GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:10:00.260192 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-79494cb0-85f8-4a38-adde-c5afbf1319ac tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:00.261783 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-79494cb0-85f8-4a38-adde-c5afbf1319ac tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:00.266046 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_api:SELECT=29 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:10:00.272982 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-79494cb0-85f8-4a38-adde-c5afbf1319ac tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:00.274018 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-79494cb0-85f8-4a38-adde-c5afbf1319ac tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:00.274783 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-79494cb0-85f8-4a38-adde-c5afbf1319ac tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:00.275599 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-79494cb0-85f8-4a38-adde-c5afbf1319ac tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:00.276238 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-79494cb0-85f8-4a38-adde-c5afbf1319ac tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:00.276915 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-79494cb0-85f8-4a38-adde-c5afbf1319ac tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:00.298776 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:10:00.459645 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-79494cb0-85f8-4a38-adde-c5afbf1319ac tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:00.468325 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-79494cb0-85f8-4a38-adde-c5afbf1319ac tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:00.470429 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-79494cb0-85f8-4a38-adde-c5afbf1319ac tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:00.471898 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-79494cb0-85f8-4a38-adde-c5afbf1319ac tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1741 microversion: 2.20 time: 0.216095 Oct 11 12:10:00.473047 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 379/769] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:10:00 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1741 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:10:01.045317 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8cfaa592-ef6b-4063-bc3c-85694b6e96c4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "607ba423-61b3-4fb1-a38c-00b2fc29d5ed"}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:10:01.047833 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8cfaa592-ef6b-4063-bc3c-85694b6e96c4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:01.054743 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8cfaa592-ef6b-4063-bc3c-85694b6e96c4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:01.055225 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8cfaa592-ef6b-4063-bc3c-85694b6e96c4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:01.055676 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8cfaa592-ef6b-4063-bc3c-85694b6e96c4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:01.056365 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8cfaa592-ef6b-4063-bc3c-85694b6e96c4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:01.056806 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8cfaa592-ef6b-4063-bc3c-85694b6e96c4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:01.057220 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8cfaa592-ef6b-4063-bc3c-85694b6e96c4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:01.427393 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8cfaa592-ef6b-4063-bc3c-85694b6e96c4 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "POST /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.385916 Oct 11 12:10:01.428033 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 391/770] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Oct 11 12:10:01 2022] POST /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38/os-volume_attachments => generated 194 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:10:01.499385 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-9de7efde-3ac7-4b3d-88b2-9d7ade6c2751 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:01.500128 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-9de7efde-3ac7-4b3d-88b2-9d7ade6c2751 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:01.508096 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9de7efde-3ac7-4b3d-88b2-9d7ade6c2751 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:01.508497 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9de7efde-3ac7-4b3d-88b2-9d7ade6c2751 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:01.509027 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9de7efde-3ac7-4b3d-88b2-9d7ade6c2751 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:01.509909 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9de7efde-3ac7-4b3d-88b2-9d7ade6c2751 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:01.510359 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9de7efde-3ac7-4b3d-88b2-9d7ade6c2751 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:01.511049 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9de7efde-3ac7-4b3d-88b2-9d7ade6c2751 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:01.652574 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-9de7efde-3ac7-4b3d-88b2-9d7ade6c2751 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:01.661789 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-9de7efde-3ac7-4b3d-88b2-9d7ade6c2751 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:01.663261 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-9de7efde-3ac7-4b3d-88b2-9d7ade6c2751 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:01.664470 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-9de7efde-3ac7-4b3d-88b2-9d7ade6c2751 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1741 microversion: 2.20 time: 0.169099 Oct 11 12:10:01.665022 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 380/771] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:10:01 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1741 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 12:10:02.691622 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ee8d8d9b-a849-4a7f-b8fb-9873abd43afc tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:02.692320 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ee8d8d9b-a849-4a7f-b8fb-9873abd43afc tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:02.698809 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ee8d8d9b-a849-4a7f-b8fb-9873abd43afc tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:02.699320 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ee8d8d9b-a849-4a7f-b8fb-9873abd43afc tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:02.699746 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ee8d8d9b-a849-4a7f-b8fb-9873abd43afc tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:02.700456 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ee8d8d9b-a849-4a7f-b8fb-9873abd43afc tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:02.700897 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ee8d8d9b-a849-4a7f-b8fb-9873abd43afc tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:02.701307 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ee8d8d9b-a849-4a7f-b8fb-9873abd43afc tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:02.858381 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ee8d8d9b-a849-4a7f-b8fb-9873abd43afc tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:02.867305 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ee8d8d9b-a849-4a7f-b8fb-9873abd43afc tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:02.868726 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ee8d8d9b-a849-4a7f-b8fb-9873abd43afc tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:02.869885 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ee8d8d9b-a849-4a7f-b8fb-9873abd43afc tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1723 microversion: 2.20 time: 0.183128 Oct 11 12:10:02.870435 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 392/772] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:10:02 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:10:03.901662 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-b51645c7-0521-4cbe-9e97-69d2affaf70a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:03.902469 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-b51645c7-0521-4cbe-9e97-69d2affaf70a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:03.910598 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b51645c7-0521-4cbe-9e97-69d2affaf70a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:03.911110 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b51645c7-0521-4cbe-9e97-69d2affaf70a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:03.911544 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b51645c7-0521-4cbe-9e97-69d2affaf70a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:03.912240 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b51645c7-0521-4cbe-9e97-69d2affaf70a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:03.912686 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b51645c7-0521-4cbe-9e97-69d2affaf70a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:03.913103 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b51645c7-0521-4cbe-9e97-69d2affaf70a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:04.052834 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-b51645c7-0521-4cbe-9e97-69d2affaf70a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:04.065671 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-b51645c7-0521-4cbe-9e97-69d2affaf70a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:04.067888 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-b51645c7-0521-4cbe-9e97-69d2affaf70a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:04.069718 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-b51645c7-0521-4cbe-9e97-69d2affaf70a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1723 microversion: 2.20 time: 0.174524 Oct 11 12:10:04.070581 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 381/773] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:10:03 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:10:05.098015 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f2f9b166-4617-490f-9bc3-eb5d2f18f78e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:05.099579 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f2f9b166-4617-490f-9bc3-eb5d2f18f78e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:05.106095 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f2f9b166-4617-490f-9bc3-eb5d2f18f78e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:05.106596 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f2f9b166-4617-490f-9bc3-eb5d2f18f78e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:05.107036 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f2f9b166-4617-490f-9bc3-eb5d2f18f78e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:05.107737 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f2f9b166-4617-490f-9bc3-eb5d2f18f78e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:05.108179 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f2f9b166-4617-490f-9bc3-eb5d2f18f78e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:05.108595 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f2f9b166-4617-490f-9bc3-eb5d2f18f78e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:05.311712 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f2f9b166-4617-490f-9bc3-eb5d2f18f78e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:05.320586 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f2f9b166-4617-490f-9bc3-eb5d2f18f78e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:05.322021 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f2f9b166-4617-490f-9bc3-eb5d2f18f78e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:05.323224 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f2f9b166-4617-490f-9bc3-eb5d2f18f78e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1726 microversion: 2.20 time: 0.229359 Oct 11 12:10:05.323818 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 393/774] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:10:05 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1726 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:10:05.348366 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-080a9c01-f3ca-4352-98a3-2c5d2d47983b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1366d85e-82bc-425a-8818-6f0a541c41ac"}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:10:05.350706 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-080a9c01-f3ca-4352-98a3-2c5d2d47983b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:05.357387 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-080a9c01-f3ca-4352-98a3-2c5d2d47983b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:05.357870 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-080a9c01-f3ca-4352-98a3-2c5d2d47983b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:05.358301 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-080a9c01-f3ca-4352-98a3-2c5d2d47983b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:05.359029 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-080a9c01-f3ca-4352-98a3-2c5d2d47983b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:05.359477 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-080a9c01-f3ca-4352-98a3-2c5d2d47983b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:05.359897 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-080a9c01-f3ca-4352-98a3-2c5d2d47983b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:05.657255 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-e0963e98-4a48-4fdc-968f-781af9634d65 req-12547126-bce4-47cb-8061-a260168dcd1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f1f910a-6135-426a-97a7-570948cf922c", "name": "network-vif-unplugged", "status": "completed", "tag": "4781df9c-1cb1-4999-a0a2-4e1d4e77d276"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:10:05.659257 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-080a9c01-f3ca-4352-98a3-2c5d2d47983b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "POST /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.314204 Oct 11 12:10:05.665274 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 382/775] 10.222.0.59 () {62 vars in 1364 bytes} [Tue Oct 11 12:10:05 2022] POST /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments => generated 188 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 12:10:05.668057 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-e0963e98-4a48-4fdc-968f-781af9634d65 req-12547126-bce4-47cb-8061-a260168dcd1d service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:05.668524 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-e0963e98-4a48-4fdc-968f-781af9634d65 req-12547126-bce4-47cb-8061-a260168dcd1d service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:05.669206 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-e0963e98-4a48-4fdc-968f-781af9634d65 req-12547126-bce4-47cb-8061-a260168dcd1d service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:05.682646 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.compute.server_external_events [req-e0963e98-4a48-4fdc-968f-781af9634d65 req-12547126-bce4-47cb-8061-a260168dcd1d service nova] Unable to find a host for instance 2f1f910a-6135-426a-97a7-570948cf922c. Dropping event network-vif-unplugged {{(pid=118995) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 11 12:10:05.683604 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-e0963e98-4a48-4fdc-968f-781af9634d65 req-12547126-bce4-47cb-8061-a260168dcd1d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030394 Oct 11 12:10:05.684939 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 394/776] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 11 12:10:05.793269 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-817d0dca-33a5-419f-a12e-29e66c1d85e4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:10:05.794288 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-817d0dca-33a5-419f-a12e-29e66c1d85e4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:05.801400 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-817d0dca-33a5-419f-a12e-29e66c1d85e4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:05.801893 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-817d0dca-33a5-419f-a12e-29e66c1d85e4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:05.802339 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-817d0dca-33a5-419f-a12e-29e66c1d85e4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:05.803075 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-817d0dca-33a5-419f-a12e-29e66c1d85e4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:05.803528 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-817d0dca-33a5-419f-a12e-29e66c1d85e4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:05.803952 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-817d0dca-33a5-419f-a12e-29e66c1d85e4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:05.847676 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-817d0dca-33a5-419f-a12e-29e66c1d85e4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118994) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 11 12:10:05.927676 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-817d0dca-33a5-419f-a12e-29e66c1d85e4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "POST /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/action" status: 202 len: 0 microversion: 2.20 time: 0.138395 Oct 11 12:10:05.928784 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 383/777] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Oct 11 12:10:05 2022] POST /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 12:10:05.936780 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-267a09f1-94a7-486f-b5a2-ffc90c49dfa4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:05.937388 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-267a09f1-94a7-486f-b5a2-ffc90c49dfa4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:05.943736 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-267a09f1-94a7-486f-b5a2-ffc90c49dfa4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:05.944213 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-267a09f1-94a7-486f-b5a2-ffc90c49dfa4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:05.944637 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-267a09f1-94a7-486f-b5a2-ffc90c49dfa4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:05.945325 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-267a09f1-94a7-486f-b5a2-ffc90c49dfa4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:05.945770 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-267a09f1-94a7-486f-b5a2-ffc90c49dfa4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:05.946181 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-267a09f1-94a7-486f-b5a2-ffc90c49dfa4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:06.095381 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-267a09f1-94a7-486f-b5a2-ffc90c49dfa4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:06.104473 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-267a09f1-94a7-486f-b5a2-ffc90c49dfa4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:06.106020 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-267a09f1-94a7-486f-b5a2-ffc90c49dfa4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:06.107211 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-267a09f1-94a7-486f-b5a2-ffc90c49dfa4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1752 microversion: 2.20 time: 0.174398 Oct 11 12:10:06.107999 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 395/778] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:10:05 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1752 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:10:07.134425 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-861221cc-f408-4f20-bbc0-605b2936c7d4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:07.134985 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-861221cc-f408-4f20-bbc0-605b2936c7d4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:07.142334 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-861221cc-f408-4f20-bbc0-605b2936c7d4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:07.142974 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-861221cc-f408-4f20-bbc0-605b2936c7d4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:07.143404 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-861221cc-f408-4f20-bbc0-605b2936c7d4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:07.144088 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-861221cc-f408-4f20-bbc0-605b2936c7d4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:07.144530 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-861221cc-f408-4f20-bbc0-605b2936c7d4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:07.144943 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-861221cc-f408-4f20-bbc0-605b2936c7d4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:07.286315 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-861221cc-f408-4f20-bbc0-605b2936c7d4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:07.295705 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-861221cc-f408-4f20-bbc0-605b2936c7d4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:07.297127 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-861221cc-f408-4f20-bbc0-605b2936c7d4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:07.298289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-861221cc-f408-4f20-bbc0-605b2936c7d4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1754 microversion: 2.20 time: 0.168027 Oct 11 12:10:07.298917 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 384/779] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:10:07 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:10:08.324037 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-1c2e50d8-16bd-45a8-9a50-0dee837eff6b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:08.324643 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-1c2e50d8-16bd-45a8-9a50-0dee837eff6b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:08.331864 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1c2e50d8-16bd-45a8-9a50-0dee837eff6b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:08.332351 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1c2e50d8-16bd-45a8-9a50-0dee837eff6b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:08.332779 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1c2e50d8-16bd-45a8-9a50-0dee837eff6b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:08.333473 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1c2e50d8-16bd-45a8-9a50-0dee837eff6b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:08.333922 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1c2e50d8-16bd-45a8-9a50-0dee837eff6b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:08.334344 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1c2e50d8-16bd-45a8-9a50-0dee837eff6b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:08.473045 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-1c2e50d8-16bd-45a8-9a50-0dee837eff6b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:08.481979 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-1c2e50d8-16bd-45a8-9a50-0dee837eff6b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:08.483545 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-1c2e50d8-16bd-45a8-9a50-0dee837eff6b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:08.484846 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-1c2e50d8-16bd-45a8-9a50-0dee837eff6b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1754 microversion: 2.20 time: 0.164801 Oct 11 12:10:08.485476 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 396/780] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:10:08 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1754 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:10:09.128825 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-ef87e2d5-77cd-45ad-810a-1bd423d70576 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:09.129409 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-ef87e2d5-77cd-45ad-810a-1bd423d70576 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:09.136573 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ef87e2d5-77cd-45ad-810a-1bd423d70576 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:09.137165 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ef87e2d5-77cd-45ad-810a-1bd423d70576 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:09.137595 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ef87e2d5-77cd-45ad-810a-1bd423d70576 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:09.138293 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ef87e2d5-77cd-45ad-810a-1bd423d70576 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:09.138778 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ef87e2d5-77cd-45ad-810a-1bd423d70576 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:09.139197 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ef87e2d5-77cd-45ad-810a-1bd423d70576 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:09.224102 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.objects.instance [None req-ef87e2d5-77cd-45ad-810a-1bd423d70576 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lazy-loading 'services' on Instance uuid 5902c505-fc30-4239-b20e-2b5b1f213c38 {{(pid=118994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:10:09.307515 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-ef87e2d5-77cd-45ad-810a-1bd423d70576 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38/os-volume_attachments/607ba423-61b3-4fb1-a38c-00b2fc29d5ed" status: 202 len: 0 microversion: 2.1 time: 0.182705 Oct 11 12:10:09.308398 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 385/781] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Oct 11 12:10:09 2022] DELETE /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38/os-volume_attachments/607ba423-61b3-4fb1-a38c-00b2fc29d5ed => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 12:10:09.316776 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9035d3b9-d530-481e-b3a1-b552a4b30362 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:09.319370 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9035d3b9-d530-481e-b3a1-b552a4b30362 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:09.325729 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9035d3b9-d530-481e-b3a1-b552a4b30362 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:09.326635 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9035d3b9-d530-481e-b3a1-b552a4b30362 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:09.326863 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9035d3b9-d530-481e-b3a1-b552a4b30362 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:09.327656 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9035d3b9-d530-481e-b3a1-b552a4b30362 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:09.328196 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9035d3b9-d530-481e-b3a1-b552a4b30362 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:09.328676 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9035d3b9-d530-481e-b3a1-b552a4b30362 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:09.361782 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9035d3b9-d530-481e-b3a1-b552a4b30362 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048856 Oct 11 12:10:09.362279 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 397/782] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Oct 11 12:10:09 2022] GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:10:09.512408 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-26498059-a094-4bca-8a1c-84293df5d9c5 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:09.513362 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-26498059-a094-4bca-8a1c-84293df5d9c5 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:09.521398 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-26498059-a094-4bca-8a1c-84293df5d9c5 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:09.521896 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-26498059-a094-4bca-8a1c-84293df5d9c5 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:09.522297 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-26498059-a094-4bca-8a1c-84293df5d9c5 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:09.523013 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-26498059-a094-4bca-8a1c-84293df5d9c5 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:09.523452 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-26498059-a094-4bca-8a1c-84293df5d9c5 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:09.523864 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-26498059-a094-4bca-8a1c-84293df5d9c5 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:09.663695 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-26498059-a094-4bca-8a1c-84293df5d9c5 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:09.677000 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-26498059-a094-4bca-8a1c-84293df5d9c5 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:09.679291 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-26498059-a094-4bca-8a1c-84293df5d9c5 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:09.681098 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-26498059-a094-4bca-8a1c-84293df5d9c5 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1810 microversion: 2.20 time: 0.173875 Oct 11 12:10:09.681921 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 386/783] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:10:09 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:10:10.376866 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9779c5b0-1bce-4894-ad0a-b97b70a2f0e2 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:10.379336 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9779c5b0-1bce-4894-ad0a-b97b70a2f0e2 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:10.388478 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9779c5b0-1bce-4894-ad0a-b97b70a2f0e2 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:10.389349 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9779c5b0-1bce-4894-ad0a-b97b70a2f0e2 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:10.390119 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9779c5b0-1bce-4894-ad0a-b97b70a2f0e2 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:10.391742 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9779c5b0-1bce-4894-ad0a-b97b70a2f0e2 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:10.392536 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9779c5b0-1bce-4894-ad0a-b97b70a2f0e2 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:10.393282 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9779c5b0-1bce-4894-ad0a-b97b70a2f0e2 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:10.433333 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9779c5b0-1bce-4894-ad0a-b97b70a2f0e2 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062232 Oct 11 12:10:10.434124 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 398/784] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Oct 11 12:10:10 2022] GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 12:10:10.500634 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-ea2c5429-ec54-4484-8b65-ebbcbfa82b10 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:10.501237 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-ea2c5429-ec54-4484-8b65-ebbcbfa82b10 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:10.507905 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ea2c5429-ec54-4484-8b65-ebbcbfa82b10 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:10.508386 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ea2c5429-ec54-4484-8b65-ebbcbfa82b10 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:10.508816 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ea2c5429-ec54-4484-8b65-ebbcbfa82b10 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:10.509504 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ea2c5429-ec54-4484-8b65-ebbcbfa82b10 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:10.509953 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ea2c5429-ec54-4484-8b65-ebbcbfa82b10 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:10.510363 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ea2c5429-ec54-4484-8b65-ebbcbfa82b10 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:10.536551 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-ea2c5429-ec54-4484-8b65-ebbcbfa82b10 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Going to try to terminate instance {{(pid=118994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 12:10:10.615755 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-ea2c5429-ec54-4484-8b65-ebbcbfa82b10 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38" status: 204 len: 0 microversion: 2.1 time: 0.118548 Oct 11 12:10:10.616398 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 387/785] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Oct 11 12:10:10 2022] DELETE /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 12:10:10.625935 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-27299358-572d-4b3d-a71b-a1e7aafeb90b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:10.626820 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-27299358-572d-4b3d-a71b-a1e7aafeb90b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:10.633321 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-27299358-572d-4b3d-a71b-a1e7aafeb90b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:10.633797 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-27299358-572d-4b3d-a71b-a1e7aafeb90b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:10.634417 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-27299358-572d-4b3d-a71b-a1e7aafeb90b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:10.635149 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-27299358-572d-4b3d-a71b-a1e7aafeb90b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:10.635630 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-27299358-572d-4b3d-a71b-a1e7aafeb90b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:10.636163 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-27299358-572d-4b3d-a71b-a1e7aafeb90b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:10.708181 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-bafa6e8d-0967-4038-830f-db5f3f6f07b2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:10.708892 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-bafa6e8d-0967-4038-830f-db5f3f6f07b2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:10.715101 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bafa6e8d-0967-4038-830f-db5f3f6f07b2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:10.715586 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bafa6e8d-0967-4038-830f-db5f3f6f07b2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:10.716023 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bafa6e8d-0967-4038-830f-db5f3f6f07b2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:10.716735 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bafa6e8d-0967-4038-830f-db5f3f6f07b2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:10.717164 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bafa6e8d-0967-4038-830f-db5f3f6f07b2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:10.717594 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bafa6e8d-0967-4038-830f-db5f3f6f07b2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:10.769649 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-27299358-572d-4b3d-a71b-a1e7aafeb90b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:10.777814 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-27299358-572d-4b3d-a71b-a1e7aafeb90b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38" status: 200 len: 1682 microversion: 2.1 time: 0.156884 Oct 11 12:10:10.778392 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 399/786] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:10 2022] GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:10.851931 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-bafa6e8d-0967-4038-830f-db5f3f6f07b2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:10.860716 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-bafa6e8d-0967-4038-830f-db5f3f6f07b2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:10.862158 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-bafa6e8d-0967-4038-830f-db5f3f6f07b2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:10.863428 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-bafa6e8d-0967-4038-830f-db5f3f6f07b2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1810 microversion: 2.20 time: 0.160193 Oct 11 12:10:10.863989 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 388/787] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:10:10 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:10:11.801535 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-685eb7d7-240e-441c-94ae-586f6120049a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:11.802119 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-685eb7d7-240e-441c-94ae-586f6120049a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:11.809466 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-685eb7d7-240e-441c-94ae-586f6120049a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:11.809945 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-685eb7d7-240e-441c-94ae-586f6120049a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:11.810375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-685eb7d7-240e-441c-94ae-586f6120049a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:11.811093 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-685eb7d7-240e-441c-94ae-586f6120049a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:11.811540 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-685eb7d7-240e-441c-94ae-586f6120049a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:11.811964 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-685eb7d7-240e-441c-94ae-586f6120049a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:11.900270 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-19c84018-84e6-45a3-8280-9915b8446791 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:11.900848 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-19c84018-84e6-45a3-8280-9915b8446791 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:11.908362 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-19c84018-84e6-45a3-8280-9915b8446791 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:11.908977 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-19c84018-84e6-45a3-8280-9915b8446791 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:11.909450 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-19c84018-84e6-45a3-8280-9915b8446791 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:11.910261 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-19c84018-84e6-45a3-8280-9915b8446791 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:11.910809 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-19c84018-84e6-45a3-8280-9915b8446791 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:11.911289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-19c84018-84e6-45a3-8280-9915b8446791 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:11.962853 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-685eb7d7-240e-441c-94ae-586f6120049a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:11.971269 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-685eb7d7-240e-441c-94ae-586f6120049a tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38" status: 200 len: 1682 microversion: 2.1 time: 0.173730 Oct 11 12:10:11.972070 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 400/788] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:11 2022] GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 => generated 1682 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:12.047975 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-19c84018-84e6-45a3-8280-9915b8446791 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:12.050346 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=6,nova_cell1:UPDATE=6 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:10:12.058233 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-19c84018-84e6-45a3-8280-9915b8446791 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:12.059593 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-19c84018-84e6-45a3-8280-9915b8446791 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:12.060748 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-19c84018-84e6-45a3-8280-9915b8446791 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1810 microversion: 2.20 time: 0.164555 Oct 11 12:10:12.061327 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 389/789] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:10:11 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 12:10:12.483116 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2ef0cc3a-b7ed-4af3-8dce-1e4deeef5a55 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:12.483611 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2ef0cc3a-b7ed-4af3-8dce-1e4deeef5a55 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: 685030b8-7128-4366-a241-55617cbe5b1f] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:12.490041 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2ef0cc3a-b7ed-4af3-8dce-1e4deeef5a55 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:12.490570 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2ef0cc3a-b7ed-4af3-8dce-1e4deeef5a55 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:12.491011 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2ef0cc3a-b7ed-4af3-8dce-1e4deeef5a55 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:12.491729 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2ef0cc3a-b7ed-4af3-8dce-1e4deeef5a55 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:12.492177 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2ef0cc3a-b7ed-4af3-8dce-1e4deeef5a55 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:12.492618 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2ef0cc3a-b7ed-4af3-8dce-1e4deeef5a55 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:12.517061 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2ef0cc3a-b7ed-4af3-8dce-1e4deeef5a55 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f/ips" status: 200 len: 146 microversion: 2.1 time: 0.037747 Oct 11 12:10:12.517636 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 401/790] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Oct 11 12:10:12 2022] GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:10:12.998573 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-957229c0-adf1-420d-a94a-35f7f71fa4c5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:13.001802 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-957229c0-adf1-420d-a94a-35f7f71fa4c5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:13.013341 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-957229c0-adf1-420d-a94a-35f7f71fa4c5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:13.014603 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-957229c0-adf1-420d-a94a-35f7f71fa4c5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:13.016194 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-957229c0-adf1-420d-a94a-35f7f71fa4c5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:13.017441 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-957229c0-adf1-420d-a94a-35f7f71fa4c5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:13.018519 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-957229c0-adf1-420d-a94a-35f7f71fa4c5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:13.019390 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-957229c0-adf1-420d-a94a-35f7f71fa4c5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:13.086102 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6d8f93e5-434b-4f93-a276-a303301beddb tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:13.086864 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-6d8f93e5-434b-4f93-a276-a303301beddb tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:13.096203 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6d8f93e5-434b-4f93-a276-a303301beddb tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:13.103203 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6d8f93e5-434b-4f93-a276-a303301beddb tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:13.104020 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6d8f93e5-434b-4f93-a276-a303301beddb tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:13.104974 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6d8f93e5-434b-4f93-a276-a303301beddb tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:13.105647 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6d8f93e5-434b-4f93-a276-a303301beddb tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:13.106269 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6d8f93e5-434b-4f93-a276-a303301beddb tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:13.188460 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-957229c0-adf1-420d-a94a-35f7f71fa4c5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:13.196974 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-957229c0-adf1-420d-a94a-35f7f71fa4c5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38" status: 200 len: 1682 microversion: 2.1 time: 0.204362 Oct 11 12:10:13.198823 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 390/791] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:12 2022] GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 => generated 1682 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:13.681588 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6d8f93e5-434b-4f93-a276-a303301beddb tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:13.690230 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6d8f93e5-434b-4f93-a276-a303301beddb tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:13.691835 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6d8f93e5-434b-4f93-a276-a303301beddb tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:13.692986 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6d8f93e5-434b-4f93-a276-a303301beddb tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1810 microversion: 2.20 time: 0.611264 Oct 11 12:10:13.693546 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 402/792] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:10:13 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1810 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:10:13.946492 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-5126016f-3c27-43be-aafd-4465e6a92785 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cf869940-d7ef-499c-959c-615a0f887458"}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:10:13.949836 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-5126016f-3c27-43be-aafd-4465e6a92785 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: 685030b8-7128-4366-a241-55617cbe5b1f] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:13.963902 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5126016f-3c27-43be-aafd-4465e6a92785 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:13.964939 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5126016f-3c27-43be-aafd-4465e6a92785 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:13.965703 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5126016f-3c27-43be-aafd-4465e6a92785 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:13.966587 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5126016f-3c27-43be-aafd-4465e6a92785 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:13.967137 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5126016f-3c27-43be-aafd-4465e6a92785 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:13.967847 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5126016f-3c27-43be-aafd-4465e6a92785 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:14.155009 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-79cf1b86-a5e8-4570-bce2-d777ca83c6be req-722e4290-1b8d-4fa3-b7cd-c41a75e3dcf2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5902c505-fc30-4239-b20e-2b5b1f213c38", "name": "network-vif-deleted", "tag": "b29d9996-d1dc-46fb-aba2-3d0f27d4ffba"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:10:14.165982 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-79cf1b86-a5e8-4570-bce2-d777ca83c6be req-722e4290-1b8d-4fa3-b7cd-c41a75e3dcf2 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:14.166490 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-79cf1b86-a5e8-4570-bce2-d777ca83c6be req-722e4290-1b8d-4fa3-b7cd-c41a75e3dcf2 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:14.166940 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-79cf1b86-a5e8-4570-bce2-d777ca83c6be req-722e4290-1b8d-4fa3-b7cd-c41a75e3dcf2 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:14.203337 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-79cf1b86-a5e8-4570-bce2-d777ca83c6be req-722e4290-1b8d-4fa3-b7cd-c41a75e3dcf2 service nova] Creating event network-vif-deleted:b29d9996-d1dc-46fb-aba2-3d0f27d4ffba for instance 5902c505-fc30-4239-b20e-2b5b1f213c38 on hv-cinder-82099 Oct 11 12:10:14.209837 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-79cf1b86-a5e8-4570-bce2-d777ca83c6be req-722e4290-1b8d-4fa3-b7cd-c41a75e3dcf2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059132 Oct 11 12:10:14.211306 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 403/793] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:10:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 12:10:14.224277 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-216177f9-6721-48ab-b77e-ec1d7ed3ee85 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:14.225067 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-216177f9-6721-48ab-b77e-ec1d7ed3ee85 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:14.231510 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-216177f9-6721-48ab-b77e-ec1d7ed3ee85 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:14.232081 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-216177f9-6721-48ab-b77e-ec1d7ed3ee85 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:14.232580 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-216177f9-6721-48ab-b77e-ec1d7ed3ee85 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:14.233392 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-216177f9-6721-48ab-b77e-ec1d7ed3ee85 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:14.233894 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-216177f9-6721-48ab-b77e-ec1d7ed3ee85 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:14.234389 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-216177f9-6721-48ab-b77e-ec1d7ed3ee85 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:14.329685 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-216177f9-6721-48ab-b77e-ec1d7ed3ee85 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:14.337917 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-216177f9-6721-48ab-b77e-ec1d7ed3ee85 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38" status: 200 len: 1614 microversion: 2.1 time: 0.118054 Oct 11 12:10:14.339050 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 404/794] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:14 2022] GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 => generated 1614 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:10:14.727984 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-26743e40-1a4d-4616-a77c-faef7bf9e612 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:14.728848 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-26743e40-1a4d-4616-a77c-faef7bf9e612 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:14.735421 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-26743e40-1a4d-4616-a77c-faef7bf9e612 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:14.736470 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-26743e40-1a4d-4616-a77c-faef7bf9e612 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:14.737108 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-26743e40-1a4d-4616-a77c-faef7bf9e612 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:14.738185 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-26743e40-1a4d-4616-a77c-faef7bf9e612 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:14.738894 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-26743e40-1a4d-4616-a77c-faef7bf9e612 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:14.739833 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-26743e40-1a4d-4616-a77c-faef7bf9e612 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:14.888407 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-26743e40-1a4d-4616-a77c-faef7bf9e612 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:14.901765 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-26743e40-1a4d-4616-a77c-faef7bf9e612 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:14.903524 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-26743e40-1a4d-4616-a77c-faef7bf9e612 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:14.904864 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-26743e40-1a4d-4616-a77c-faef7bf9e612 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1810 microversion: 2.20 time: 0.181005 Oct 11 12:10:14.906199 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 405/795] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:10:14 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:10:15.362429 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9c8dad4e-f15c-48f2-bf01-e7c5b114ad27 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:15.363948 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9c8dad4e-f15c-48f2-bf01-e7c5b114ad27 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:15.371934 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c8dad4e-f15c-48f2-bf01-e7c5b114ad27 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:15.372704 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c8dad4e-f15c-48f2-bf01-e7c5b114ad27 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:15.373316 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c8dad4e-f15c-48f2-bf01-e7c5b114ad27 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:15.374234 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c8dad4e-f15c-48f2-bf01-e7c5b114ad27 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:15.375488 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c8dad4e-f15c-48f2-bf01-e7c5b114ad27 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:15.376173 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c8dad4e-f15c-48f2-bf01-e7c5b114ad27 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:15.444718 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-9c8dad4e-f15c-48f2-bf01-e7c5b114ad27 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:15.453111 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9c8dad4e-f15c-48f2-bf01-e7c5b114ad27 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38" status: 200 len: 1614 microversion: 2.1 time: 0.094647 Oct 11 12:10:15.453669 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 406/796] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:15 2022] GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 => generated 1614 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:15.935245 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-fc07510e-6dea-4230-833b-7f4454132cca tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:15.936321 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-fc07510e-6dea-4230-833b-7f4454132cca tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:15.948249 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fc07510e-6dea-4230-833b-7f4454132cca tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:15.949126 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fc07510e-6dea-4230-833b-7f4454132cca tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:15.949908 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fc07510e-6dea-4230-833b-7f4454132cca tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:15.950869 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fc07510e-6dea-4230-833b-7f4454132cca tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:15.951328 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fc07510e-6dea-4230-833b-7f4454132cca tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:15.951757 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fc07510e-6dea-4230-833b-7f4454132cca tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:15.969486 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:10:16.108855 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-fc07510e-6dea-4230-833b-7f4454132cca tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:16.118579 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-fc07510e-6dea-4230-833b-7f4454132cca tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:16.120167 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-fc07510e-6dea-4230-833b-7f4454132cca tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:16.121335 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-fc07510e-6dea-4230-833b-7f4454132cca tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1810 microversion: 2.20 time: 0.193943 Oct 11 12:10:16.122873 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 407/797] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:10:15 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1810 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:10:16.476780 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-55f4ab99-52c2-443b-a645-139fe7d3038b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:16.477528 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-55f4ab99-52c2-443b-a645-139fe7d3038b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:16.484375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-55f4ab99-52c2-443b-a645-139fe7d3038b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:16.484921 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-55f4ab99-52c2-443b-a645-139fe7d3038b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:16.485409 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-55f4ab99-52c2-443b-a645-139fe7d3038b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:16.486135 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-55f4ab99-52c2-443b-a645-139fe7d3038b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:16.486592 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-55f4ab99-52c2-443b-a645-139fe7d3038b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:16.487003 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-55f4ab99-52c2-443b-a645-139fe7d3038b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:16.564449 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-55f4ab99-52c2-443b-a645-139fe7d3038b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:16.573291 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-55f4ab99-52c2-443b-a645-139fe7d3038b tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38" status: 200 len: 1614 microversion: 2.1 time: 0.100567 Oct 11 12:10:16.577474 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 408/798] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:16 2022] GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 => generated 1614 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:17.147607 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-91c983b9-7292-4211-b0f5-b7d7832770cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:17.148420 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-91c983b9-7292-4211-b0f5-b7d7832770cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:17.155211 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-91c983b9-7292-4211-b0f5-b7d7832770cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:17.155690 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-91c983b9-7292-4211-b0f5-b7d7832770cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:17.156126 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-91c983b9-7292-4211-b0f5-b7d7832770cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:17.156868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-91c983b9-7292-4211-b0f5-b7d7832770cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:17.157291 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-91c983b9-7292-4211-b0f5-b7d7832770cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:17.157710 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-91c983b9-7292-4211-b0f5-b7d7832770cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:17.295003 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-91c983b9-7292-4211-b0f5-b7d7832770cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:17.304265 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-91c983b9-7292-4211-b0f5-b7d7832770cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:17.305679 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-91c983b9-7292-4211-b0f5-b7d7832770cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:17.306856 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-91c983b9-7292-4211-b0f5-b7d7832770cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1810 microversion: 2.20 time: 0.163388 Oct 11 12:10:17.307629 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 409/799] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:10:17 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 12:10:17.597927 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a3d06c5a-2675-4ea3-9a19-e7747389cde1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:17.599426 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a3d06c5a-2675-4ea3-9a19-e7747389cde1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:17.606033 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a3d06c5a-2675-4ea3-9a19-e7747389cde1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:17.606853 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a3d06c5a-2675-4ea3-9a19-e7747389cde1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:17.612498 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a3d06c5a-2675-4ea3-9a19-e7747389cde1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:17.613334 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a3d06c5a-2675-4ea3-9a19-e7747389cde1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:17.615077 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a3d06c5a-2675-4ea3-9a19-e7747389cde1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:17.615841 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a3d06c5a-2675-4ea3-9a19-e7747389cde1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:17.686842 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a3d06c5a-2675-4ea3-9a19-e7747389cde1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:17.695108 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a3d06c5a-2675-4ea3-9a19-e7747389cde1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38" status: 200 len: 1614 microversion: 2.1 time: 0.101469 Oct 11 12:10:17.696062 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 410/800] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:17 2022] GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 => generated 1614 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:18.332157 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-267e4498-9a16-4ca6-8154-39d082c03b19 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:18.332751 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-267e4498-9a16-4ca6-8154-39d082c03b19 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:18.339288 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-267e4498-9a16-4ca6-8154-39d082c03b19 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:18.339775 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-267e4498-9a16-4ca6-8154-39d082c03b19 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:18.340203 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-267e4498-9a16-4ca6-8154-39d082c03b19 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:18.341011 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-267e4498-9a16-4ca6-8154-39d082c03b19 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:18.341464 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-267e4498-9a16-4ca6-8154-39d082c03b19 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:18.341907 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-267e4498-9a16-4ca6-8154-39d082c03b19 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:18.484331 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-267e4498-9a16-4ca6-8154-39d082c03b19 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:18.493872 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-267e4498-9a16-4ca6-8154-39d082c03b19 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:18.495472 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-267e4498-9a16-4ca6-8154-39d082c03b19 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:18.497167 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-267e4498-9a16-4ca6-8154-39d082c03b19 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1810 microversion: 2.20 time: 0.169063 Oct 11 12:10:18.497916 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 411/801] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:10:18 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1810 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:10:18.719219 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-69b81196-ed56-4e5d-a37a-66ff353b36e3 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:18.719925 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-69b81196-ed56-4e5d-a37a-66ff353b36e3 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:18.731216 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69b81196-ed56-4e5d-a37a-66ff353b36e3 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:18.731836 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69b81196-ed56-4e5d-a37a-66ff353b36e3 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:18.732373 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69b81196-ed56-4e5d-a37a-66ff353b36e3 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:18.733181 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69b81196-ed56-4e5d-a37a-66ff353b36e3 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:18.733703 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69b81196-ed56-4e5d-a37a-66ff353b36e3 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:18.734235 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69b81196-ed56-4e5d-a37a-66ff353b36e3 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:18.798038 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-69b81196-ed56-4e5d-a37a-66ff353b36e3 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:18.806704 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-69b81196-ed56-4e5d-a37a-66ff353b36e3 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38" status: 200 len: 1614 microversion: 2.1 time: 0.091436 Oct 11 12:10:18.815132 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 412/802] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:18 2022] GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 => generated 1614 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:18.823815 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9bc15e5f-c8cc-4d44-b726-94f83d7ad9f9 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:10:18.824699 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9bc15e5f-c8cc-4d44-b726-94f83d7ad9f9 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:18.832349 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9bc15e5f-c8cc-4d44-b726-94f83d7ad9f9 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:18.832827 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9bc15e5f-c8cc-4d44-b726-94f83d7ad9f9 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:18.833308 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9bc15e5f-c8cc-4d44-b726-94f83d7ad9f9 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:18.833998 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9bc15e5f-c8cc-4d44-b726-94f83d7ad9f9 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:18.834449 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9bc15e5f-c8cc-4d44-b726-94f83d7ad9f9 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:18.834891 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9bc15e5f-c8cc-4d44-b726-94f83d7ad9f9 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:18.859745 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-9bc15e5f-c8cc-4d44-b726-94f83d7ad9f9 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lazy-loading 'flavor' on Instance uuid 5ddb150d-886c-46f4-9c3d-0722148d7d91 {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:10:18.954954 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9bc15e5f-c8cc-4d44-b726-94f83d7ad9f9 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "POST /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91/action" status: 202 len: 0 microversion: 2.1 time: 0.138062 Oct 11 12:10:18.955893 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 413/803] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Oct 11 12:10:18 2022] POST /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 12:10:18.970529 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7de122b3-4764-4556-ac39-e3e29f0526c0 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:18.971478 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7de122b3-4764-4556-ac39-e3e29f0526c0 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:18.978589 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7de122b3-4764-4556-ac39-e3e29f0526c0 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:18.979083 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7de122b3-4764-4556-ac39-e3e29f0526c0 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:18.979522 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7de122b3-4764-4556-ac39-e3e29f0526c0 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:18.980475 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7de122b3-4764-4556-ac39-e3e29f0526c0 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:18.980655 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7de122b3-4764-4556-ac39-e3e29f0526c0 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:18.981102 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7de122b3-4764-4556-ac39-e3e29f0526c0 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:19.134814 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7de122b3-4764-4556-ac39-e3e29f0526c0 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:19.145464 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7de122b3-4764-4556-ac39-e3e29f0526c0 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1568 microversion: 2.1 time: 0.182749 Oct 11 12:10:19.146233 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 414/804] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:18 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1568 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:19.523928 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2a4611b8-b285-4f4a-83f1-069cb6534ac3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:19.524648 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2a4611b8-b285-4f4a-83f1-069cb6534ac3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:19.531236 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2a4611b8-b285-4f4a-83f1-069cb6534ac3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:19.531807 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2a4611b8-b285-4f4a-83f1-069cb6534ac3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:19.532333 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2a4611b8-b285-4f4a-83f1-069cb6534ac3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:19.533131 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2a4611b8-b285-4f4a-83f1-069cb6534ac3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:19.533641 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2a4611b8-b285-4f4a-83f1-069cb6534ac3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:19.534107 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2a4611b8-b285-4f4a-83f1-069cb6534ac3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:19.716100 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2a4611b8-b285-4f4a-83f1-069cb6534ac3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:19.731951 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2a4611b8-b285-4f4a-83f1-069cb6534ac3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:19.734658 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2a4611b8-b285-4f4a-83f1-069cb6534ac3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:19.736651 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2a4611b8-b285-4f4a-83f1-069cb6534ac3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1810 microversion: 2.20 time: 0.216522 Oct 11 12:10:19.761014 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 415/805] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:10:19 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1810 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:10:19.830876 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f1dc1310-8642-4004-95b7-c48ee4099d63 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:19.831701 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f1dc1310-8642-4004-95b7-c48ee4099d63 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:19.839861 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f1dc1310-8642-4004-95b7-c48ee4099d63 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:19.840700 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f1dc1310-8642-4004-95b7-c48ee4099d63 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:19.841349 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f1dc1310-8642-4004-95b7-c48ee4099d63 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:19.842400 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f1dc1310-8642-4004-95b7-c48ee4099d63 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:19.843065 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f1dc1310-8642-4004-95b7-c48ee4099d63 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:19.843676 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f1dc1310-8642-4004-95b7-c48ee4099d63 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:19.910589 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f1dc1310-8642-4004-95b7-c48ee4099d63 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:19.918919 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f1dc1310-8642-4004-95b7-c48ee4099d63 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38" status: 200 len: 1614 microversion: 2.1 time: 0.092095 Oct 11 12:10:19.919467 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 416/806] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:19 2022] GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 => generated 1614 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:20.171394 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-26502bdb-34ff-49bf-9958-f802b8d6e08e tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:20.171940 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-26502bdb-34ff-49bf-9958-f802b8d6e08e tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:20.178756 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-26502bdb-34ff-49bf-9958-f802b8d6e08e tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:20.179246 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-26502bdb-34ff-49bf-9958-f802b8d6e08e tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:20.179702 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-26502bdb-34ff-49bf-9958-f802b8d6e08e tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:20.180381 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-26502bdb-34ff-49bf-9958-f802b8d6e08e tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:20.180838 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-26502bdb-34ff-49bf-9958-f802b8d6e08e tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:20.181248 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-26502bdb-34ff-49bf-9958-f802b8d6e08e tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:20.320244 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-26502bdb-34ff-49bf-9958-f802b8d6e08e tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:20.328442 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-26502bdb-34ff-49bf-9958-f802b8d6e08e tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1568 microversion: 2.1 time: 0.161123 Oct 11 12:10:20.329031 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 417/807] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:20 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:20.773366 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0986ec31-0245-4e33-8d0f-060058c01ab6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:20.774917 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0986ec31-0245-4e33-8d0f-060058c01ab6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:20.782990 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0986ec31-0245-4e33-8d0f-060058c01ab6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:20.783472 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0986ec31-0245-4e33-8d0f-060058c01ab6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:20.783896 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0986ec31-0245-4e33-8d0f-060058c01ab6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:20.784592 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0986ec31-0245-4e33-8d0f-060058c01ab6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:20.785035 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0986ec31-0245-4e33-8d0f-060058c01ab6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:20.785457 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0986ec31-0245-4e33-8d0f-060058c01ab6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:20.937607 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0986ec31-0245-4e33-8d0f-060058c01ab6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:20.947515 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0986ec31-0245-4e33-8d0f-060058c01ab6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:20.948945 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0986ec31-0245-4e33-8d0f-060058c01ab6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:20.950307 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0986ec31-0245-4e33-8d0f-060058c01ab6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1810 microversion: 2.20 time: 0.183447 Oct 11 12:10:20.951140 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 418/808] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:10:20 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1810 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:10:20.956019 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-164f82d0-5f38-4689-ad75-c39234db511f tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:20.956647 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-164f82d0-5f38-4689-ad75-c39234db511f tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:20.967446 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-164f82d0-5f38-4689-ad75-c39234db511f tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:20.968139 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-164f82d0-5f38-4689-ad75-c39234db511f tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:20.968753 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-164f82d0-5f38-4689-ad75-c39234db511f tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:20.969818 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-164f82d0-5f38-4689-ad75-c39234db511f tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:20.970422 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-164f82d0-5f38-4689-ad75-c39234db511f tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:20.971030 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-164f82d0-5f38-4689-ad75-c39234db511f tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:21.036024 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-164f82d0-5f38-4689-ad75-c39234db511f tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:21.044133 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-164f82d0-5f38-4689-ad75-c39234db511f tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38" status: 200 len: 1614 microversion: 2.1 time: 0.092093 Oct 11 12:10:21.044963 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 419/809] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:20 2022] GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 => generated 1614 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:21.352156 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3d620d77-2565-4ab4-931c-e4fd26a7b7fb tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:21.352761 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-3d620d77-2565-4ab4-931c-e4fd26a7b7fb tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:21.358959 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3d620d77-2565-4ab4-931c-e4fd26a7b7fb tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:21.359440 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3d620d77-2565-4ab4-931c-e4fd26a7b7fb tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:21.359882 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3d620d77-2565-4ab4-931c-e4fd26a7b7fb tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:21.360590 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3d620d77-2565-4ab4-931c-e4fd26a7b7fb tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:21.361025 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3d620d77-2565-4ab4-931c-e4fd26a7b7fb tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:21.361465 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3d620d77-2565-4ab4-931c-e4fd26a7b7fb tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:21.508499 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-3d620d77-2565-4ab4-931c-e4fd26a7b7fb tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:21.517181 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-3d620d77-2565-4ab4-931c-e4fd26a7b7fb tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1568 microversion: 2.1 time: 0.168921 Oct 11 12:10:21.517955 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 420/810] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:21 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:21.979957 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-708ca683-ddc8-47dd-9881-99b976653b06 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:21.980685 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-708ca683-ddc8-47dd-9881-99b976653b06 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:21.988586 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-708ca683-ddc8-47dd-9881-99b976653b06 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:21.989067 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-708ca683-ddc8-47dd-9881-99b976653b06 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:21.989596 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-708ca683-ddc8-47dd-9881-99b976653b06 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:21.990299 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-708ca683-ddc8-47dd-9881-99b976653b06 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:21.990783 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-708ca683-ddc8-47dd-9881-99b976653b06 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:21.991226 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-708ca683-ddc8-47dd-9881-99b976653b06 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:22.155769 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-708ca683-ddc8-47dd-9881-99b976653b06 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:22.166766 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-708ca683-ddc8-47dd-9881-99b976653b06 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:22.168202 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-708ca683-ddc8-47dd-9881-99b976653b06 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:22.169604 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-708ca683-ddc8-47dd-9881-99b976653b06 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1810 microversion: 2.20 time: 0.193702 Oct 11 12:10:22.170175 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 421/811] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:10:21 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1810 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:10:22.174851 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-48cfa570-59e4-490c-afbc-8ef82f502dc5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:22.175451 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-48cfa570-59e4-490c-afbc-8ef82f502dc5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:22.183283 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-48cfa570-59e4-490c-afbc-8ef82f502dc5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:22.183774 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-48cfa570-59e4-490c-afbc-8ef82f502dc5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:22.184242 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-48cfa570-59e4-490c-afbc-8ef82f502dc5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:22.184955 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-48cfa570-59e4-490c-afbc-8ef82f502dc5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:22.185407 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-48cfa570-59e4-490c-afbc-8ef82f502dc5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:22.185829 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-48cfa570-59e4-490c-afbc-8ef82f502dc5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:22.188763 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:10:22.251614 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-48cfa570-59e4-490c-afbc-8ef82f502dc5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:22.259919 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-48cfa570-59e4-490c-afbc-8ef82f502dc5 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38" status: 200 len: 1614 microversion: 2.1 time: 0.088655 Oct 11 12:10:22.260490 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 422/812] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:22 2022] GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 => generated 1614 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:22.542425 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e3c1f2fc-d0fa-4375-944a-5c313a627ec8 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:22.543058 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e3c1f2fc-d0fa-4375-944a-5c313a627ec8 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:22.549292 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e3c1f2fc-d0fa-4375-944a-5c313a627ec8 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:22.549770 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e3c1f2fc-d0fa-4375-944a-5c313a627ec8 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:22.550197 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e3c1f2fc-d0fa-4375-944a-5c313a627ec8 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:22.550903 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e3c1f2fc-d0fa-4375-944a-5c313a627ec8 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:22.551349 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e3c1f2fc-d0fa-4375-944a-5c313a627ec8 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:22.551760 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e3c1f2fc-d0fa-4375-944a-5c313a627ec8 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:22.695494 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e3c1f2fc-d0fa-4375-944a-5c313a627ec8 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:22.703389 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e3c1f2fc-d0fa-4375-944a-5c313a627ec8 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1568 microversion: 2.1 time: 0.164848 Oct 11 12:10:22.706889 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 423/813] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:22 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:23.195655 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f84dbd68-8262-4d17-adbc-fed6ff7d96ec tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:23.196371 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f84dbd68-8262-4d17-adbc-fed6ff7d96ec tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:23.203185 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f84dbd68-8262-4d17-adbc-fed6ff7d96ec tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:23.203665 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f84dbd68-8262-4d17-adbc-fed6ff7d96ec tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:23.204104 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f84dbd68-8262-4d17-adbc-fed6ff7d96ec tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:23.204780 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f84dbd68-8262-4d17-adbc-fed6ff7d96ec tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:23.205243 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f84dbd68-8262-4d17-adbc-fed6ff7d96ec tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:23.205661 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f84dbd68-8262-4d17-adbc-fed6ff7d96ec tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:23.341992 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f84dbd68-8262-4d17-adbc-fed6ff7d96ec tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:23.351033 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f84dbd68-8262-4d17-adbc-fed6ff7d96ec tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:23.352571 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f84dbd68-8262-4d17-adbc-fed6ff7d96ec tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:23.353717 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f84dbd68-8262-4d17-adbc-fed6ff7d96ec tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1810 microversion: 2.20 time: 0.162257 Oct 11 12:10:23.354447 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 424/814] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:10:23 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:10:23.358731 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8922560e-bbd0-4552-83fd-13e7d0236deb tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:23.359324 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8922560e-bbd0-4552-83fd-13e7d0236deb tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:23.364914 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8922560e-bbd0-4552-83fd-13e7d0236deb tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:23.365385 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8922560e-bbd0-4552-83fd-13e7d0236deb tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:23.365800 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8922560e-bbd0-4552-83fd-13e7d0236deb tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:23.366470 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8922560e-bbd0-4552-83fd-13e7d0236deb tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:23.366937 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8922560e-bbd0-4552-83fd-13e7d0236deb tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:23.367467 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8922560e-bbd0-4552-83fd-13e7d0236deb tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:23.440101 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8922560e-bbd0-4552-83fd-13e7d0236deb tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:23.452739 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8922560e-bbd0-4552-83fd-13e7d0236deb tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38" status: 200 len: 1614 microversion: 2.1 time: 0.097008 Oct 11 12:10:23.453552 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 425/815] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:23 2022] GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 => generated 1614 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:23.728012 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-1b67ad72-726b-439d-a885-71a3b4019922 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:23.728498 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-1b67ad72-726b-439d-a885-71a3b4019922 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:23.734900 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1b67ad72-726b-439d-a885-71a3b4019922 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:23.735314 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1b67ad72-726b-439d-a885-71a3b4019922 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:23.735743 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1b67ad72-726b-439d-a885-71a3b4019922 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:23.736423 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1b67ad72-726b-439d-a885-71a3b4019922 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:23.736865 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1b67ad72-726b-439d-a885-71a3b4019922 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:23.737283 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1b67ad72-726b-439d-a885-71a3b4019922 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:23.872740 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-1b67ad72-726b-439d-a885-71a3b4019922 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:23.880703 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-1b67ad72-726b-439d-a885-71a3b4019922 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1568 microversion: 2.1 time: 0.157633 Oct 11 12:10:23.881269 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 426/816] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:23 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:23.958854 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:10:24.054132 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=13 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:10:24.381525 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-077eeb8e-a042-4d5c-9778-630d3cd85f98 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:24.382433 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-077eeb8e-a042-4d5c-9778-630d3cd85f98 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:24.393806 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-077eeb8e-a042-4d5c-9778-630d3cd85f98 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:24.394671 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-077eeb8e-a042-4d5c-9778-630d3cd85f98 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:24.395326 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-077eeb8e-a042-4d5c-9778-630d3cd85f98 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:24.396424 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-077eeb8e-a042-4d5c-9778-630d3cd85f98 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:24.397221 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-077eeb8e-a042-4d5c-9778-630d3cd85f98 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:24.397906 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-077eeb8e-a042-4d5c-9778-630d3cd85f98 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:24.540229 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-077eeb8e-a042-4d5c-9778-630d3cd85f98 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:24.549310 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-077eeb8e-a042-4d5c-9778-630d3cd85f98 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:24.550864 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-077eeb8e-a042-4d5c-9778-630d3cd85f98 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:24.551896 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-077eeb8e-a042-4d5c-9778-630d3cd85f98 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1810 microversion: 2.20 time: 0.176415 Oct 11 12:10:24.552450 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 427/817] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:10:24 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:10:24.557052 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9c2356ce-0e6c-4424-9ae0-66acae4a74c1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:24.557687 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9c2356ce-0e6c-4424-9ae0-66acae4a74c1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:24.563623 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c2356ce-0e6c-4424-9ae0-66acae4a74c1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:24.564094 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c2356ce-0e6c-4424-9ae0-66acae4a74c1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:24.564508 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c2356ce-0e6c-4424-9ae0-66acae4a74c1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:24.565195 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c2356ce-0e6c-4424-9ae0-66acae4a74c1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:24.565636 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c2356ce-0e6c-4424-9ae0-66acae4a74c1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:24.566039 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9c2356ce-0e6c-4424-9ae0-66acae4a74c1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:24.632587 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-9c2356ce-0e6c-4424-9ae0-66acae4a74c1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:24.641541 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9c2356ce-0e6c-4424-9ae0-66acae4a74c1 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38" status: 200 len: 1614 microversion: 2.1 time: 0.088169 Oct 11 12:10:24.642097 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 428/818] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:24 2022] GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 => generated 1614 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:24.904638 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6be6b789-cb58-4847-9bd6-1cb298cb74a7 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:24.905155 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-6be6b789-cb58-4847-9bd6-1cb298cb74a7 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:24.911687 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6be6b789-cb58-4847-9bd6-1cb298cb74a7 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:24.912162 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6be6b789-cb58-4847-9bd6-1cb298cb74a7 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:24.912584 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6be6b789-cb58-4847-9bd6-1cb298cb74a7 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:24.913259 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6be6b789-cb58-4847-9bd6-1cb298cb74a7 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:24.913706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6be6b789-cb58-4847-9bd6-1cb298cb74a7 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:24.914119 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6be6b789-cb58-4847-9bd6-1cb298cb74a7 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:25.049945 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6be6b789-cb58-4847-9bd6-1cb298cb74a7 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:25.062085 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6be6b789-cb58-4847-9bd6-1cb298cb74a7 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1568 microversion: 2.1 time: 0.161270 Oct 11 12:10:25.063051 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 429/819] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:24 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:25.577434 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-25b8b990-e8b7-4e06-adb5-8815c0b309a3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:25.578216 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-25b8b990-e8b7-4e06-adb5-8815c0b309a3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:25.585685 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-25b8b990-e8b7-4e06-adb5-8815c0b309a3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:25.586252 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-25b8b990-e8b7-4e06-adb5-8815c0b309a3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:25.586822 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-25b8b990-e8b7-4e06-adb5-8815c0b309a3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:25.587720 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-25b8b990-e8b7-4e06-adb5-8815c0b309a3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:25.588169 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-25b8b990-e8b7-4e06-adb5-8815c0b309a3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:25.588588 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-25b8b990-e8b7-4e06-adb5-8815c0b309a3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:25.737024 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-25b8b990-e8b7-4e06-adb5-8815c0b309a3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:25.747615 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-25b8b990-e8b7-4e06-adb5-8815c0b309a3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:25.749026 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-25b8b990-e8b7-4e06-adb5-8815c0b309a3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:25.750176 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-25b8b990-e8b7-4e06-adb5-8815c0b309a3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1810 microversion: 2.20 time: 0.177094 Oct 11 12:10:25.750756 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 430/820] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:10:25 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:10:25.755143 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0201619f-d8ce-4025-b450-2c36d76e2a69 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:25.755721 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0201619f-d8ce-4025-b450-2c36d76e2a69 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:25.761666 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0201619f-d8ce-4025-b450-2c36d76e2a69 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:25.762129 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0201619f-d8ce-4025-b450-2c36d76e2a69 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:25.762569 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0201619f-d8ce-4025-b450-2c36d76e2a69 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:25.763321 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0201619f-d8ce-4025-b450-2c36d76e2a69 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:25.763780 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0201619f-d8ce-4025-b450-2c36d76e2a69 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:25.764209 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0201619f-d8ce-4025-b450-2c36d76e2a69 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:25.837717 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0201619f-d8ce-4025-b450-2c36d76e2a69 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:25.845917 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0201619f-d8ce-4025-b450-2c36d76e2a69 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38" status: 200 len: 1614 microversion: 2.1 time: 0.094194 Oct 11 12:10:25.846478 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 431/821] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:25 2022] GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 => generated 1614 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:26.090933 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7e370bfd-6c8d-4739-8a23-e9fc926fe0a3 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:26.091448 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7e370bfd-6c8d-4739-8a23-e9fc926fe0a3 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:26.097937 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7e370bfd-6c8d-4739-8a23-e9fc926fe0a3 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:26.098416 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7e370bfd-6c8d-4739-8a23-e9fc926fe0a3 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:26.098865 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7e370bfd-6c8d-4739-8a23-e9fc926fe0a3 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:26.099548 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7e370bfd-6c8d-4739-8a23-e9fc926fe0a3 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:26.099985 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7e370bfd-6c8d-4739-8a23-e9fc926fe0a3 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:26.100393 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7e370bfd-6c8d-4739-8a23-e9fc926fe0a3 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:26.239667 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7e370bfd-6c8d-4739-8a23-e9fc926fe0a3 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:26.249470 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7e370bfd-6c8d-4739-8a23-e9fc926fe0a3 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1568 microversion: 2.1 time: 0.163112 Oct 11 12:10:26.250064 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 432/822] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:26 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:26.776535 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7e5c975a-6141-4b5c-bf00-32f41d6eac81 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:26.777406 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7e5c975a-6141-4b5c-bf00-32f41d6eac81 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:26.783998 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7e5c975a-6141-4b5c-bf00-32f41d6eac81 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:26.784502 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7e5c975a-6141-4b5c-bf00-32f41d6eac81 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:26.784919 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7e5c975a-6141-4b5c-bf00-32f41d6eac81 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:26.785617 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7e5c975a-6141-4b5c-bf00-32f41d6eac81 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:26.786066 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7e5c975a-6141-4b5c-bf00-32f41d6eac81 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:26.786486 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7e5c975a-6141-4b5c-bf00-32f41d6eac81 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:26.920947 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7e5c975a-6141-4b5c-bf00-32f41d6eac81 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:26.930244 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7e5c975a-6141-4b5c-bf00-32f41d6eac81 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:26.931701 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7e5c975a-6141-4b5c-bf00-32f41d6eac81 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:26.932854 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7e5c975a-6141-4b5c-bf00-32f41d6eac81 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1810 microversion: 2.20 time: 0.160329 Oct 11 12:10:26.933419 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 433/823] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:10:26 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 12:10:26.938084 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7d5b79f9-9cb0-4fb7-8a4c-95db922fad9d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:26.938760 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7d5b79f9-9cb0-4fb7-8a4c-95db922fad9d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:26.944742 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7d5b79f9-9cb0-4fb7-8a4c-95db922fad9d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:26.945216 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7d5b79f9-9cb0-4fb7-8a4c-95db922fad9d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:26.945638 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7d5b79f9-9cb0-4fb7-8a4c-95db922fad9d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:26.946344 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7d5b79f9-9cb0-4fb7-8a4c-95db922fad9d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:26.946775 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7d5b79f9-9cb0-4fb7-8a4c-95db922fad9d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:26.947213 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7d5b79f9-9cb0-4fb7-8a4c-95db922fad9d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:27.020216 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-7d5b79f9-9cb0-4fb7-8a4c-95db922fad9d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:27.029105 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7d5b79f9-9cb0-4fb7-8a4c-95db922fad9d tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38" status: 200 len: 1327 microversion: 2.1 time: 0.094515 Oct 11 12:10:27.029533 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 434/824] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:26 2022] GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 => generated 1327 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:27.282435 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f3002dcc-4b9b-4b67-bc09-0d03e7cea3d1 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:27.282966 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f3002dcc-4b9b-4b67-bc09-0d03e7cea3d1 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:27.289583 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f3002dcc-4b9b-4b67-bc09-0d03e7cea3d1 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:27.290066 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f3002dcc-4b9b-4b67-bc09-0d03e7cea3d1 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:27.290489 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f3002dcc-4b9b-4b67-bc09-0d03e7cea3d1 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:27.291199 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f3002dcc-4b9b-4b67-bc09-0d03e7cea3d1 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:27.291638 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f3002dcc-4b9b-4b67-bc09-0d03e7cea3d1 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:27.292050 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f3002dcc-4b9b-4b67-bc09-0d03e7cea3d1 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:27.425604 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f3002dcc-4b9b-4b67-bc09-0d03e7cea3d1 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:27.434108 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f3002dcc-4b9b-4b67-bc09-0d03e7cea3d1 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1568 microversion: 2.1 time: 0.155769 Oct 11 12:10:27.434703 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 435/825] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:27 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:27.958050 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e9576a1e-80cd-4a0d-9386-216a652b07d4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:27.958789 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e9576a1e-80cd-4a0d-9386-216a652b07d4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:27.965965 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e9576a1e-80cd-4a0d-9386-216a652b07d4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:27.966322 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e9576a1e-80cd-4a0d-9386-216a652b07d4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:27.966899 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e9576a1e-80cd-4a0d-9386-216a652b07d4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:27.968003 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e9576a1e-80cd-4a0d-9386-216a652b07d4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:27.968450 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e9576a1e-80cd-4a0d-9386-216a652b07d4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:27.968869 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e9576a1e-80cd-4a0d-9386-216a652b07d4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:28.115247 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e9576a1e-80cd-4a0d-9386-216a652b07d4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:28.127756 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e9576a1e-80cd-4a0d-9386-216a652b07d4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:28.130081 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e9576a1e-80cd-4a0d-9386-216a652b07d4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:28.131489 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e9576a1e-80cd-4a0d-9386-216a652b07d4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1810 microversion: 2.20 time: 0.177311 Oct 11 12:10:28.131719 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-5126016f-3c27-43be-aafd-4465e6a92785 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "POST /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.191874 Oct 11 12:10:28.132973 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 391/826] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Oct 11 12:10:13 2022] POST /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f/os-volume_attachments => generated 194 bytes in 14194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:10:28.139198 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 436/827] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:10:27 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1810 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 12:10:28.140484 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-bac8a696-6a26-4ef6-853f-16f4fcfdf601 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:28.141840 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-bac8a696-6a26-4ef6-853f-16f4fcfdf601 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:28.156453 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bac8a696-6a26-4ef6-853f-16f4fcfdf601 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:28.157640 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bac8a696-6a26-4ef6-853f-16f4fcfdf601 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:28.158264 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bac8a696-6a26-4ef6-853f-16f4fcfdf601 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:28.159037 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bac8a696-6a26-4ef6-853f-16f4fcfdf601 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:28.159500 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bac8a696-6a26-4ef6-853f-16f4fcfdf601 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:28.159929 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bac8a696-6a26-4ef6-853f-16f4fcfdf601 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:28.194997 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bac8a696-6a26-4ef6-853f-16f4fcfdf601 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:28.195260 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bac8a696-6a26-4ef6-853f-16f4fcfdf601 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:28.196027 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-bac8a696-6a26-4ef6-853f-16f4fcfdf601 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:28.198909 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.objects.instance [None req-bac8a696-6a26-4ef6-853f-16f4fcfdf601 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lazy-loading 'fault' on Instance uuid 5902c505-fc30-4239-b20e-2b5b1f213c38 {{(pid=118994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:10:28.239665 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-bac8a696-6a26-4ef6-853f-16f4fcfdf601 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:28.251026 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-bac8a696-6a26-4ef6-853f-16f4fcfdf601 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38" status: 200 len: 1332 microversion: 2.1 time: 0.116279 Oct 11 12:10:28.251629 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 392/828] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:28 2022] GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 => generated 1332 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:28.458137 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8581fa62-c0f8-450f-9177-00fb954ac393 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:28.458777 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8581fa62-c0f8-450f-9177-00fb954ac393 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:28.465226 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8581fa62-c0f8-450f-9177-00fb954ac393 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:28.465708 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8581fa62-c0f8-450f-9177-00fb954ac393 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:28.466179 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8581fa62-c0f8-450f-9177-00fb954ac393 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:28.466912 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8581fa62-c0f8-450f-9177-00fb954ac393 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:28.467351 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8581fa62-c0f8-450f-9177-00fb954ac393 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:28.467768 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8581fa62-c0f8-450f-9177-00fb954ac393 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:28.610730 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8581fa62-c0f8-450f-9177-00fb954ac393 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:28.622844 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8581fa62-c0f8-450f-9177-00fb954ac393 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1568 microversion: 2.1 time: 0.168640 Oct 11 12:10:28.623414 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 437/829] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:28 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1568 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:29.160284 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-2fd35972-fe03-41c5-b39b-131d5ea380e3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:29.160911 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-2fd35972-fe03-41c5-b39b-131d5ea380e3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:29.169971 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2fd35972-fe03-41c5-b39b-131d5ea380e3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:29.170447 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2fd35972-fe03-41c5-b39b-131d5ea380e3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:29.170920 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2fd35972-fe03-41c5-b39b-131d5ea380e3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:29.171611 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2fd35972-fe03-41c5-b39b-131d5ea380e3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:29.172057 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2fd35972-fe03-41c5-b39b-131d5ea380e3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:29.172471 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2fd35972-fe03-41c5-b39b-131d5ea380e3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:29.274755 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3e4c12da-4818-4e1b-beca-e05e142ed4e0 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:29.275369 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-3e4c12da-4818-4e1b-beca-e05e142ed4e0 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:29.283021 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3e4c12da-4818-4e1b-beca-e05e142ed4e0 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:29.283512 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3e4c12da-4818-4e1b-beca-e05e142ed4e0 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:29.283946 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3e4c12da-4818-4e1b-beca-e05e142ed4e0 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:29.284654 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3e4c12da-4818-4e1b-beca-e05e142ed4e0 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:29.285107 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3e4c12da-4818-4e1b-beca-e05e142ed4e0 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:29.285529 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3e4c12da-4818-4e1b-beca-e05e142ed4e0 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:29.316915 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3e4c12da-4818-4e1b-beca-e05e142ed4e0 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:29.317431 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3e4c12da-4818-4e1b-beca-e05e142ed4e0 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:29.317864 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3e4c12da-4818-4e1b-beca-e05e142ed4e0 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:29.318309 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-3e4c12da-4818-4e1b-beca-e05e142ed4e0 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lazy-loading 'fault' on Instance uuid 5902c505-fc30-4239-b20e-2b5b1f213c38 {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:10:29.321142 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=100 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:10:29.322163 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-2fd35972-fe03-41c5-b39b-131d5ea380e3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:29.331220 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-2fd35972-fe03-41c5-b39b-131d5ea380e3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:29.332670 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-2fd35972-fe03-41c5-b39b-131d5ea380e3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:29.333821 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-2fd35972-fe03-41c5-b39b-131d5ea380e3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1810 microversion: 2.20 time: 0.179476 Oct 11 12:10:29.334383 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 393/830] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:10:29 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1810 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:10:29.360297 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-3e4c12da-4818-4e1b-beca-e05e142ed4e0 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '41d3680dda7c4cc8aeb6d086efca0775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c83f971a0ae04288a5c6dc87d3370979', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:29.368045 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-3e4c12da-4818-4e1b-beca-e05e142ed4e0 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38" status: 200 len: 1332 microversion: 2.1 time: 0.097312 Oct 11 12:10:29.368611 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 438/831] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:29 2022] GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:29.645705 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-6f5d861b-9256-44a9-a624-68a33fe800e9 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:29.646303 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-6f5d861b-9256-44a9-a624-68a33fe800e9 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:29.655329 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6f5d861b-9256-44a9-a624-68a33fe800e9 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:29.656125 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6f5d861b-9256-44a9-a624-68a33fe800e9 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:29.656804 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6f5d861b-9256-44a9-a624-68a33fe800e9 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:29.657720 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6f5d861b-9256-44a9-a624-68a33fe800e9 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:29.658401 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6f5d861b-9256-44a9-a624-68a33fe800e9 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:29.659473 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6f5d861b-9256-44a9-a624-68a33fe800e9 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:29.803396 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-6f5d861b-9256-44a9-a624-68a33fe800e9 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:29.811377 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-6f5d861b-9256-44a9-a624-68a33fe800e9 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1568 microversion: 2.1 time: 0.169494 Oct 11 12:10:29.811938 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 394/832] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:29 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:30.359461 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-77b2f199-1157-41a1-8c2b-b59852fc341f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:30.360084 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-77b2f199-1157-41a1-8c2b-b59852fc341f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:30.362401 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=100 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:10:30.367716 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-77b2f199-1157-41a1-8c2b-b59852fc341f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:30.368193 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-77b2f199-1157-41a1-8c2b-b59852fc341f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:30.368622 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-77b2f199-1157-41a1-8c2b-b59852fc341f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:30.369278 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-77b2f199-1157-41a1-8c2b-b59852fc341f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:30.369736 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-77b2f199-1157-41a1-8c2b-b59852fc341f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:30.370143 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-77b2f199-1157-41a1-8c2b-b59852fc341f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:30.392590 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-529c5749-08f1-4fe7-8bb3-08938c14e6c6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:30.393203 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-529c5749-08f1-4fe7-8bb3-08938c14e6c6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:30.400047 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-529c5749-08f1-4fe7-8bb3-08938c14e6c6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:30.400526 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-529c5749-08f1-4fe7-8bb3-08938c14e6c6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:30.400964 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-529c5749-08f1-4fe7-8bb3-08938c14e6c6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:30.401633 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-529c5749-08f1-4fe7-8bb3-08938c14e6c6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:30.402090 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-529c5749-08f1-4fe7-8bb3-08938c14e6c6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:30.402537 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-529c5749-08f1-4fe7-8bb3-08938c14e6c6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:30.416574 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.wsgi [None req-529c5749-08f1-4fe7-8bb3-08938c14e6c6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] HTTP exception thrown: Instance 5902c505-fc30-4239-b20e-2b5b1f213c38 could not be found. Oct 11 12:10:30.418598 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-529c5749-08f1-4fe7-8bb3-08938c14e6c6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Request method failure captured: Oct 11 12:10:30.418598 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: request: GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 HTTP/1.1 Oct 11 12:10:30.418598 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept: application/json Oct 11 12:10:30.418598 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept-Encoding: identity Oct 11 12:10:30.418598 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Connection: close Oct 11 12:10:30.418598 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Length: 0 Oct 11 12:10:30.418598 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Type: application/json Oct 11 12:10:30.418598 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Host: 10.222.0.59 Oct 11 12:10:30.418598 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Openstack-System-Scope: None Oct 11 12:10:30.418598 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: User-Agent: python-urllib3/1.26.12 Oct 11 12:10:30.418598 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Auth-Token: gAAAAABjRVrDbBzKTyV9eZUXZryLVe-KpT4WYEHJaER5TFyRAvTSEg5lw7FxKmfGi17rpAnxooOQ2r63AULbLGHHY4hm760kGTTUbeHuyR9-shGVTsiYjly6leZlsPXT8VYCrZ-E0QA-DYApJOgvSEAYz3JHEXcb3Qg12yFjALYOMVuEZNDDhBk Oct 11 12:10:30.418598 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Id: None Oct 11 12:10:30.418598 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Name: None Oct 11 12:10:30.418598 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Identity-Status: Confirmed Oct 11 12:10:30.418598 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Is-Admin-Project: True Oct 11 12:10:30.418598 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Id: default Oct 11 12:10:30.418598 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Name: Default Oct 11 12:10:30.418598 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Id: c83f971a0ae04288a5c6dc87d3370979 Oct 11 12:10:30.418598 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Name: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:10:30.418598 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Role: reader,member Oct 11 12:10:30.418598 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Roles: reader,member Oct 11 12:10:30.420327 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:10:30.420327 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:10:30.420327 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Id: c83f971a0ae04288a5c6dc87d3370979 Oct 11 12:10:30.420327 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:10:30.420327 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User: tempest-AttachVolumeNegativeTest-1543839758-project Oct 11 12:10:30.420327 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Id: default Oct 11 12:10:30.420327 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Name: Default Oct 11 12:10:30.420327 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Id: 41d3680dda7c4cc8aeb6d086efca0775 Oct 11 12:10:30.420327 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Name: tempest-AttachVolumeNegativeTest-1543839758-project Oct 11 12:10:30.420327 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: method: > Oct 11 12:10:30.420327 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: exception: Instance 5902c505-fc30-4239-b20e-2b5b1f213c38 could not be found. Oct 11 12:10:30.420327 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: action_args: {'id': '5902c505-fc30-4239-b20e-2b5b1f213c38'} Oct 11 12:10:30.421350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:10:30.421350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:10:30.421350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:10:30.421350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:10:30.421350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:10:30.421350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:10:30.421350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:10:30.421350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:10:30.421350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:10:30.421350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:10:30.421350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5902c505-fc30-4239-b20e-2b5b1f213c38 could not be found. Oct 11 12:10:30.421350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:10:30.421350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:10:30.421350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:10:30.421350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:10:30.421350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:10:30.421350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:10:30.421350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:10:30.421350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:10:30.421350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:10:30.423289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:10:30.423289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 12:10:30.423289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 12:10:30.423289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:10:30.423289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:10:30.423289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:10:30.423289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:10:30.423289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5902c505-fc30-4239-b20e-2b5b1f213c38 could not be found. Oct 11 12:10:30.423289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:10:30.423289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:10:30.423289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:10:30.423289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:10:30.423289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:10:30.423289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:10:30.423289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:10:30.423289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:10:30.423289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5902c505-fc30-4239-b20e-2b5b1f213c38 could not be found. Oct 11 12:10:30.423289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:10:30.424906 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-529c5749-08f1-4fe7-8bb3-08938c14e6c6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Returning 404 to user: Instance 5902c505-fc30-4239-b20e-2b5b1f213c38 could not be found. {{(pid=118994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:10:30.424906 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-529c5749-08f1-4fe7-8bb3-08938c14e6c6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38" status: 404 len: 111 microversion: 2.1 time: 0.031885 Oct 11 12:10:30.424906 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 395/833] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:30 2022] GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:10:30.429458 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-833b94a5-ce3a-45e6-80db-c63e5000e922 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '.version_select at 0x7fd406681790>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:30.450618 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-833b94a5-ce3a-45e6-80db-c63e5000e922 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1990618407" status: 202 len: 0 microversion: 2.1 time: 0.024620 Oct 11 12:10:30.453440 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 396/834] 10.222.0.59 () {58 vars in 1221 bytes} [Tue Oct 11 12:10:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1990618407 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 12:10:30.545911 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-77b2f199-1157-41a1-8c2b-b59852fc341f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:30.555568 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-77b2f199-1157-41a1-8c2b-b59852fc341f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:30.556991 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-77b2f199-1157-41a1-8c2b-b59852fc341f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:30.558260 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-77b2f199-1157-41a1-8c2b-b59852fc341f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1810 microversion: 2.20 time: 0.202859 Oct 11 12:10:30.559078 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 439/835] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:10:30 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1810 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:10:30.835783 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-4be0fab9-e572-4f37-afd1-ac13b67bf2be tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:30.836278 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-4be0fab9-e572-4f37-afd1-ac13b67bf2be tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:30.843676 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4be0fab9-e572-4f37-afd1-ac13b67bf2be tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:30.844214 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4be0fab9-e572-4f37-afd1-ac13b67bf2be tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:30.844592 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4be0fab9-e572-4f37-afd1-ac13b67bf2be tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:30.845272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4be0fab9-e572-4f37-afd1-ac13b67bf2be tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:30.845725 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4be0fab9-e572-4f37-afd1-ac13b67bf2be tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:30.846141 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4be0fab9-e572-4f37-afd1-ac13b67bf2be tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:31.047973 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-4be0fab9-e572-4f37-afd1-ac13b67bf2be tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:31.056154 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-4be0fab9-e572-4f37-afd1-ac13b67bf2be tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1568 microversion: 2.1 time: 0.225220 Oct 11 12:10:31.056737 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 397/836] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:30 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1568 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:31.587681 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e228fa7a-d992-46de-b0af-ca03ffc09ccf tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:31.588303 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e228fa7a-d992-46de-b0af-ca03ffc09ccf tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:31.596620 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e228fa7a-d992-46de-b0af-ca03ffc09ccf tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:31.597108 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e228fa7a-d992-46de-b0af-ca03ffc09ccf tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:31.597540 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e228fa7a-d992-46de-b0af-ca03ffc09ccf tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:31.598354 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e228fa7a-d992-46de-b0af-ca03ffc09ccf tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:31.598965 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e228fa7a-d992-46de-b0af-ca03ffc09ccf tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:31.599384 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e228fa7a-d992-46de-b0af-ca03ffc09ccf tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:31.739161 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e228fa7a-d992-46de-b0af-ca03ffc09ccf tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:31.748647 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e228fa7a-d992-46de-b0af-ca03ffc09ccf tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:31.750074 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e228fa7a-d992-46de-b0af-ca03ffc09ccf tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:31.751278 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e228fa7a-d992-46de-b0af-ca03ffc09ccf tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1810 microversion: 2.20 time: 0.169682 Oct 11 12:10:31.751831 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 440/837] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:10:31 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:10:32.085575 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-20dd2372-c979-4fd8-826e-dbdd3fa8ce5c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:32.086724 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-20dd2372-c979-4fd8-826e-dbdd3fa8ce5c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:32.097360 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-20dd2372-c979-4fd8-826e-dbdd3fa8ce5c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:32.097831 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-20dd2372-c979-4fd8-826e-dbdd3fa8ce5c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:32.098342 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-20dd2372-c979-4fd8-826e-dbdd3fa8ce5c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:32.099122 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-20dd2372-c979-4fd8-826e-dbdd3fa8ce5c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:32.099620 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-20dd2372-c979-4fd8-826e-dbdd3fa8ce5c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:32.100074 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-20dd2372-c979-4fd8-826e-dbdd3fa8ce5c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:32.241144 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-20dd2372-c979-4fd8-826e-dbdd3fa8ce5c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:32.254376 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-20dd2372-c979-4fd8-826e-dbdd3fa8ce5c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1568 microversion: 2.1 time: 0.176982 Oct 11 12:10:32.255315 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 398/838] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:32 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:32.366103 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-610003c6-00e6-42e5-9b89-08755047d840 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:32.366773 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-610003c6-00e6-42e5-9b89-08755047d840 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:32.373707 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-610003c6-00e6-42e5-9b89-08755047d840 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:32.374188 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-610003c6-00e6-42e5-9b89-08755047d840 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:32.374615 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-610003c6-00e6-42e5-9b89-08755047d840 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:32.375446 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-610003c6-00e6-42e5-9b89-08755047d840 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:32.375753 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-610003c6-00e6-42e5-9b89-08755047d840 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:32.376463 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-610003c6-00e6-42e5-9b89-08755047d840 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:32.389905 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-610003c6-00e6-42e5-9b89-08755047d840 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] HTTP exception thrown: Instance 5902c505-fc30-4239-b20e-2b5b1f213c38 could not be found. Oct 11 12:10:32.392002 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-610003c6-00e6-42e5-9b89-08755047d840 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Request method failure captured: Oct 11 12:10:32.392002 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: request: DELETE /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 HTTP/1.1 Oct 11 12:10:32.392002 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 11 12:10:32.392002 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 11 12:10:32.392002 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Connection: close Oct 11 12:10:32.392002 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 11 12:10:32.392002 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 11 12:10:32.392002 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Host: 10.222.0.59 Oct 11 12:10:32.392002 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 11 12:10:32.392002 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 11 12:10:32.392002 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjRVrDbBzKTyV9eZUXZryLVe-KpT4WYEHJaER5TFyRAvTSEg5lw7FxKmfGi17rpAnxooOQ2r63AULbLGHHY4hm760kGTTUbeHuyR9-shGVTsiYjly6leZlsPXT8VYCrZ-E0QA-DYApJOgvSEAYz3JHEXcb3Qg12yFjALYOMVuEZNDDhBk Oct 11 12:10:32.392002 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 11 12:10:32.392002 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 11 12:10:32.392002 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 11 12:10:32.392002 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 11 12:10:32.392002 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 11 12:10:32.392002 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 11 12:10:32.392002 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Id: c83f971a0ae04288a5c6dc87d3370979 Oct 11 12:10:32.392002 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:10:32.392002 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Role: reader,member Oct 11 12:10:32.392002 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Roles: reader,member Oct 11 12:10:32.393523 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:10:32.393523 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:10:32.393523 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Id: c83f971a0ae04288a5c6dc87d3370979 Oct 11 12:10:32.393523 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:10:32.393523 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User: tempest-AttachVolumeNegativeTest-1543839758-project Oct 11 12:10:32.393523 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 11 12:10:32.393523 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 11 12:10:32.393523 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Id: 41d3680dda7c4cc8aeb6d086efca0775 Oct 11 12:10:32.393523 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-AttachVolumeNegativeTest-1543839758-project Oct 11 12:10:32.393523 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: method: > Oct 11 12:10:32.393523 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: exception: Instance 5902c505-fc30-4239-b20e-2b5b1f213c38 could not be found. Oct 11 12:10:32.393523 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: action_args: {'id': '5902c505-fc30-4239-b20e-2b5b1f213c38'} Oct 11 12:10:32.394382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:10:32.394382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:10:32.394382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:10:32.394382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:10:32.394382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:10:32.394382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:10:32.394382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:10:32.394382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:10:32.394382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:10:32.394382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:10:32.394382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5902c505-fc30-4239-b20e-2b5b1f213c38 could not be found. Oct 11 12:10:32.394382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:10:32.394382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:10:32.394382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:10:32.394382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:10:32.394382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:10:32.394382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:10:32.394382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:10:32.394382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:10:32.394382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:10:32.395899 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:10:32.395899 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 12:10:32.395899 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 12:10:32.395899 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 12:10:32.395899 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 12:10:32.395899 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:10:32.395899 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:10:32.395899 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:10:32.395899 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:10:32.395899 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5902c505-fc30-4239-b20e-2b5b1f213c38 could not be found. Oct 11 12:10:32.395899 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:10:32.395899 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:10:32.395899 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:10:32.395899 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:10:32.395899 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:10:32.395899 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:10:32.395899 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:10:32.395899 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:10:32.395899 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5902c505-fc30-4239-b20e-2b5b1f213c38 could not be found. Oct 11 12:10:32.395899 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:10:32.398421 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-610003c6-00e6-42e5-9b89-08755047d840 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Returning 404 to user: Instance 5902c505-fc30-4239-b20e-2b5b1f213c38 could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:10:32.398421 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-610003c6-00e6-42e5-9b89-08755047d840 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38" status: 404 len: 111 microversion: 2.1 time: 0.031406 Oct 11 12:10:32.398421 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 441/839] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Oct 11 12:10:32 2022] DELETE /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:10:32.405383 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-16750e15-bdc8-45fd-bc32-5290a6de3bbe tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:32.406335 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-16750e15-bdc8-45fd-bc32-5290a6de3bbe tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 5902c505-fc30-4239-b20e-2b5b1f213c38] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:32.414078 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-16750e15-bdc8-45fd-bc32-5290a6de3bbe tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:32.414599 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-16750e15-bdc8-45fd-bc32-5290a6de3bbe tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:32.415036 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-16750e15-bdc8-45fd-bc32-5290a6de3bbe tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:32.415736 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-16750e15-bdc8-45fd-bc32-5290a6de3bbe tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:32.416181 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-16750e15-bdc8-45fd-bc32-5290a6de3bbe tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:32.416591 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-16750e15-bdc8-45fd-bc32-5290a6de3bbe tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:32.433455 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.wsgi [None req-16750e15-bdc8-45fd-bc32-5290a6de3bbe tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] HTTP exception thrown: Instance 5902c505-fc30-4239-b20e-2b5b1f213c38 could not be found. Oct 11 12:10:32.435172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-16750e15-bdc8-45fd-bc32-5290a6de3bbe tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Request method failure captured: Oct 11 12:10:32.435172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: request: GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 HTTP/1.1 Oct 11 12:10:32.435172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept: application/json Oct 11 12:10:32.435172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept-Encoding: identity Oct 11 12:10:32.435172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Connection: close Oct 11 12:10:32.435172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Length: 0 Oct 11 12:10:32.435172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Type: application/json Oct 11 12:10:32.435172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Host: 10.222.0.59 Oct 11 12:10:32.435172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Openstack-System-Scope: None Oct 11 12:10:32.435172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: User-Agent: python-urllib3/1.26.12 Oct 11 12:10:32.435172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Auth-Token: gAAAAABjRVrDbBzKTyV9eZUXZryLVe-KpT4WYEHJaER5TFyRAvTSEg5lw7FxKmfGi17rpAnxooOQ2r63AULbLGHHY4hm760kGTTUbeHuyR9-shGVTsiYjly6leZlsPXT8VYCrZ-E0QA-DYApJOgvSEAYz3JHEXcb3Qg12yFjALYOMVuEZNDDhBk Oct 11 12:10:32.435172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Id: None Oct 11 12:10:32.435172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Name: None Oct 11 12:10:32.435172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Identity-Status: Confirmed Oct 11 12:10:32.435172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Is-Admin-Project: True Oct 11 12:10:32.435172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Id: default Oct 11 12:10:32.435172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Name: Default Oct 11 12:10:32.435172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Id: c83f971a0ae04288a5c6dc87d3370979 Oct 11 12:10:32.435172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Name: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:10:32.435172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Role: reader,member Oct 11 12:10:32.435172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Roles: reader,member Oct 11 12:10:32.436462 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:10:32.436462 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:10:32.436462 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Id: c83f971a0ae04288a5c6dc87d3370979 Oct 11 12:10:32.436462 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:10:32.436462 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User: tempest-AttachVolumeNegativeTest-1543839758-project Oct 11 12:10:32.436462 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Id: default Oct 11 12:10:32.436462 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Name: Default Oct 11 12:10:32.436462 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Id: 41d3680dda7c4cc8aeb6d086efca0775 Oct 11 12:10:32.436462 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Name: tempest-AttachVolumeNegativeTest-1543839758-project Oct 11 12:10:32.436462 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: method: > Oct 11 12:10:32.436462 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: exception: Instance 5902c505-fc30-4239-b20e-2b5b1f213c38 could not be found. Oct 11 12:10:32.436462 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: action_args: {'id': '5902c505-fc30-4239-b20e-2b5b1f213c38'} Oct 11 12:10:32.441371 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:10:32.441371 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:10:32.441371 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:10:32.441371 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:10:32.441371 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:10:32.441371 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:10:32.441371 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:10:32.441371 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:10:32.441371 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:10:32.441371 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:10:32.441371 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5902c505-fc30-4239-b20e-2b5b1f213c38 could not be found. Oct 11 12:10:32.441371 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:10:32.441371 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:10:32.441371 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:10:32.441371 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:10:32.441371 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:10:32.441371 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:10:32.441371 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:10:32.441371 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:10:32.441371 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:10:32.443146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:10:32.443146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 12:10:32.443146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 12:10:32.443146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:10:32.443146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:10:32.443146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:10:32.443146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:10:32.443146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5902c505-fc30-4239-b20e-2b5b1f213c38 could not be found. Oct 11 12:10:32.443146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:10:32.443146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:10:32.443146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:10:32.443146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:10:32.443146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:10:32.443146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:10:32.443146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:10:32.443146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:10:32.443146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5902c505-fc30-4239-b20e-2b5b1f213c38 could not be found. Oct 11 12:10:32.443146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:10:32.444535 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-16750e15-bdc8-45fd-bc32-5290a6de3bbe tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Returning 404 to user: Instance 5902c505-fc30-4239-b20e-2b5b1f213c38 could not be found. {{(pid=118994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:10:32.444535 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-16750e15-bdc8-45fd-bc32-5290a6de3bbe tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38" status: 404 len: 111 microversion: 2.1 time: 0.038458 Oct 11 12:10:32.444535 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 399/840] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:32 2022] GET /compute/v2.1/servers/5902c505-fc30-4239-b20e-2b5b1f213c38 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:10:32.780235 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-06ead175-b867-44b3-a8f8-406e9322ea5e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:32.780965 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-06ead175-b867-44b3-a8f8-406e9322ea5e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:32.789787 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06ead175-b867-44b3-a8f8-406e9322ea5e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:32.790501 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06ead175-b867-44b3-a8f8-406e9322ea5e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:32.791116 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06ead175-b867-44b3-a8f8-406e9322ea5e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:32.792088 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06ead175-b867-44b3-a8f8-406e9322ea5e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:32.792731 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06ead175-b867-44b3-a8f8-406e9322ea5e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:32.793300 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06ead175-b867-44b3-a8f8-406e9322ea5e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:32.944555 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-06ead175-b867-44b3-a8f8-406e9322ea5e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:32.953676 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-06ead175-b867-44b3-a8f8-406e9322ea5e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:32.955147 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-06ead175-b867-44b3-a8f8-406e9322ea5e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:32.956332 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-06ead175-b867-44b3-a8f8-406e9322ea5e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1810 microversion: 2.20 time: 0.181571 Oct 11 12:10:32.956897 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 442/841] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:10:32 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:10:33.282901 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-1aef0c10-8e49-43e1-8fda-ff7d55e8550c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:33.283514 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-1aef0c10-8e49-43e1-8fda-ff7d55e8550c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:33.290396 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1aef0c10-8e49-43e1-8fda-ff7d55e8550c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:33.290917 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1aef0c10-8e49-43e1-8fda-ff7d55e8550c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:33.291348 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1aef0c10-8e49-43e1-8fda-ff7d55e8550c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:33.292059 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1aef0c10-8e49-43e1-8fda-ff7d55e8550c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:33.292505 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1aef0c10-8e49-43e1-8fda-ff7d55e8550c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:33.292924 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1aef0c10-8e49-43e1-8fda-ff7d55e8550c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:33.430535 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-1aef0c10-8e49-43e1-8fda-ff7d55e8550c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:33.439123 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-1aef0c10-8e49-43e1-8fda-ff7d55e8550c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1568 microversion: 2.1 time: 0.160564 Oct 11 12:10:33.439730 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 400/842] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:33 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:33.581267 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b9511c7b-27f2-4f97-816a-6b564b8dffd2 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:33.581759 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-b9511c7b-27f2-4f97-816a-6b564b8dffd2 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: c568e704-7d29-4312-957d-35ed16806e9e] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:33.588088 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b9511c7b-27f2-4f97-816a-6b564b8dffd2 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:33.588564 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b9511c7b-27f2-4f97-816a-6b564b8dffd2 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:33.588986 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b9511c7b-27f2-4f97-816a-6b564b8dffd2 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:33.589662 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b9511c7b-27f2-4f97-816a-6b564b8dffd2 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:33.590105 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b9511c7b-27f2-4f97-816a-6b564b8dffd2 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:33.590513 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b9511c7b-27f2-4f97-816a-6b564b8dffd2 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:33.759534 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-b9511c7b-27f2-4f97-816a-6b564b8dffd2 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] HTTP exception thrown: Instance c568e704-7d29-4312-957d-35ed16806e9e could not be found. Oct 11 12:10:33.761155 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b9511c7b-27f2-4f97-816a-6b564b8dffd2 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Request method failure captured: Oct 11 12:10:33.761155 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: request: DELETE /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e HTTP/1.1 Oct 11 12:10:33.761155 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 11 12:10:33.761155 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 11 12:10:33.761155 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Connection: close Oct 11 12:10:33.761155 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 11 12:10:33.761155 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 11 12:10:33.761155 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Host: 10.222.0.59 Oct 11 12:10:33.761155 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 11 12:10:33.761155 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 11 12:10:33.761155 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjRVrDbBzKTyV9eZUXZryLVe-KpT4WYEHJaER5TFyRAvTSEg5lw7FxKmfGi17rpAnxooOQ2r63AULbLGHHY4hm760kGTTUbeHuyR9-shGVTsiYjly6leZlsPXT8VYCrZ-E0QA-DYApJOgvSEAYz3JHEXcb3Qg12yFjALYOMVuEZNDDhBk Oct 11 12:10:33.761155 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 11 12:10:33.761155 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 11 12:10:33.761155 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 11 12:10:33.761155 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 11 12:10:33.761155 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 11 12:10:33.761155 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 11 12:10:33.761155 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Id: c83f971a0ae04288a5c6dc87d3370979 Oct 11 12:10:33.761155 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:10:33.761155 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Role: reader,member Oct 11 12:10:33.761155 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Roles: reader,member Oct 11 12:10:33.763019 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:10:33.763019 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:10:33.763019 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Id: c83f971a0ae04288a5c6dc87d3370979 Oct 11 12:10:33.763019 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:10:33.763019 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User: tempest-AttachVolumeNegativeTest-1543839758-project Oct 11 12:10:33.763019 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 11 12:10:33.763019 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 11 12:10:33.763019 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Id: 41d3680dda7c4cc8aeb6d086efca0775 Oct 11 12:10:33.763019 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-AttachVolumeNegativeTest-1543839758-project Oct 11 12:10:33.763019 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: method: > Oct 11 12:10:33.763019 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: exception: Instance c568e704-7d29-4312-957d-35ed16806e9e could not be found. Oct 11 12:10:33.763019 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: action_args: {'id': 'c568e704-7d29-4312-957d-35ed16806e9e'} Oct 11 12:10:33.763891 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:10:33.763891 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:10:33.763891 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:10:33.763891 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:10:33.763891 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:10:33.763891 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:10:33.763891 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:10:33.763891 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:10:33.763891 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:10:33.763891 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:10:33.763891 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c568e704-7d29-4312-957d-35ed16806e9e could not be found. Oct 11 12:10:33.763891 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:10:33.763891 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:10:33.763891 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:10:33.763891 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:10:33.763891 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:10:33.763891 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:10:33.763891 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:10:33.763891 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:10:33.763891 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:10:33.765278 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:10:33.765278 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 12:10:33.765278 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 12:10:33.765278 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 12:10:33.765278 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 12:10:33.765278 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:10:33.765278 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:10:33.765278 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:10:33.765278 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:10:33.765278 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c568e704-7d29-4312-957d-35ed16806e9e could not be found. Oct 11 12:10:33.765278 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:10:33.765278 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:10:33.765278 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:10:33.765278 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:10:33.765278 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:10:33.765278 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:10:33.765278 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:10:33.765278 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:10:33.765278 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c568e704-7d29-4312-957d-35ed16806e9e could not be found. Oct 11 12:10:33.765278 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:10:33.767058 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b9511c7b-27f2-4f97-816a-6b564b8dffd2 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Returning 404 to user: Instance c568e704-7d29-4312-957d-35ed16806e9e could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:10:33.767058 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b9511c7b-27f2-4f97-816a-6b564b8dffd2 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e" status: 404 len: 111 microversion: 2.1 time: 0.185310 Oct 11 12:10:33.767058 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 443/843] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Oct 11 12:10:33 2022] DELETE /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e => generated 111 bytes in 186 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:10:33.772246 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-91b1a344-6295-4c4b-94a9-a344d9f2c05c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:33.772939 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-91b1a344-6295-4c4b-94a9-a344d9f2c05c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: c568e704-7d29-4312-957d-35ed16806e9e] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:33.779098 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-91b1a344-6295-4c4b-94a9-a344d9f2c05c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:33.779829 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-91b1a344-6295-4c4b-94a9-a344d9f2c05c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:33.780258 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-91b1a344-6295-4c4b-94a9-a344d9f2c05c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:33.780950 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-91b1a344-6295-4c4b-94a9-a344d9f2c05c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:33.781386 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-91b1a344-6295-4c4b-94a9-a344d9f2c05c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:33.781794 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-91b1a344-6295-4c4b-94a9-a344d9f2c05c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:33.795202 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-6b667147-3d13-405b-896e-9a54b3f8c0eb req-13280cc9-9753-44b2-9010-e8c613cdc5fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f1f910a-6135-426a-97a7-570948cf922c", "name": "network-vif-plugged", "status": "completed", "tag": "4781df9c-1cb1-4999-a0a2-4e1d4e77d276"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:10:33.796068 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.wsgi [None req-91b1a344-6295-4c4b-94a9-a344d9f2c05c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] HTTP exception thrown: Instance c568e704-7d29-4312-957d-35ed16806e9e could not be found. Oct 11 12:10:33.797738 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-91b1a344-6295-4c4b-94a9-a344d9f2c05c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Request method failure captured: Oct 11 12:10:33.797738 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: request: GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e HTTP/1.1 Oct 11 12:10:33.797738 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept: application/json Oct 11 12:10:33.797738 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept-Encoding: identity Oct 11 12:10:33.797738 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Connection: close Oct 11 12:10:33.797738 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Length: 0 Oct 11 12:10:33.797738 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Type: application/json Oct 11 12:10:33.797738 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Host: 10.222.0.59 Oct 11 12:10:33.797738 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Openstack-System-Scope: None Oct 11 12:10:33.797738 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: User-Agent: python-urllib3/1.26.12 Oct 11 12:10:33.797738 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Auth-Token: gAAAAABjRVrDbBzKTyV9eZUXZryLVe-KpT4WYEHJaER5TFyRAvTSEg5lw7FxKmfGi17rpAnxooOQ2r63AULbLGHHY4hm760kGTTUbeHuyR9-shGVTsiYjly6leZlsPXT8VYCrZ-E0QA-DYApJOgvSEAYz3JHEXcb3Qg12yFjALYOMVuEZNDDhBk Oct 11 12:10:33.797738 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Id: None Oct 11 12:10:33.797738 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Name: None Oct 11 12:10:33.797738 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Identity-Status: Confirmed Oct 11 12:10:33.797738 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Is-Admin-Project: True Oct 11 12:10:33.797738 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Id: default Oct 11 12:10:33.797738 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Name: Default Oct 11 12:10:33.797738 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Id: c83f971a0ae04288a5c6dc87d3370979 Oct 11 12:10:33.797738 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Name: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:10:33.797738 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Role: reader,member Oct 11 12:10:33.797738 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Roles: reader,member Oct 11 12:10:33.799394 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:10:33.799394 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:10:33.799394 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Id: c83f971a0ae04288a5c6dc87d3370979 Oct 11 12:10:33.799394 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:10:33.799394 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User: tempest-AttachVolumeNegativeTest-1543839758-project Oct 11 12:10:33.799394 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Id: default Oct 11 12:10:33.799394 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Name: Default Oct 11 12:10:33.799394 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Id: 41d3680dda7c4cc8aeb6d086efca0775 Oct 11 12:10:33.799394 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Name: tempest-AttachVolumeNegativeTest-1543839758-project Oct 11 12:10:33.799394 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: method: > Oct 11 12:10:33.799394 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: exception: Instance c568e704-7d29-4312-957d-35ed16806e9e could not be found. Oct 11 12:10:33.799394 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: action_args: {'id': 'c568e704-7d29-4312-957d-35ed16806e9e'} Oct 11 12:10:33.800285 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:10:33.800285 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:10:33.800285 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:10:33.800285 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:10:33.800285 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:10:33.800285 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:10:33.800285 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:10:33.800285 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:10:33.800285 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:10:33.800285 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:10:33.800285 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c568e704-7d29-4312-957d-35ed16806e9e could not be found. Oct 11 12:10:33.800285 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:10:33.800285 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:10:33.800285 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:10:33.800285 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:10:33.800285 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:10:33.800285 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:10:33.800285 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:10:33.800285 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:10:33.800285 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:10:33.801731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:10:33.801731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 12:10:33.801731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 12:10:33.801731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:10:33.801731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:10:33.801731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:10:33.801731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:10:33.801731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c568e704-7d29-4312-957d-35ed16806e9e could not be found. Oct 11 12:10:33.801731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:10:33.801731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:10:33.801731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:10:33.801731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:10:33.801731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:10:33.801731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:10:33.801731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:10:33.801731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:10:33.801731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c568e704-7d29-4312-957d-35ed16806e9e could not be found. Oct 11 12:10:33.801731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:10:33.806239 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-91b1a344-6295-4c4b-94a9-a344d9f2c05c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Returning 404 to user: Instance c568e704-7d29-4312-957d-35ed16806e9e could not be found. {{(pid=118994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:10:33.806239 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-91b1a344-6295-4c4b-94a9-a344d9f2c05c tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e" status: 404 len: 111 microversion: 2.1 time: 0.032876 Oct 11 12:10:33.806239 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 401/844] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:33 2022] GET /compute/v2.1/servers/c568e704-7d29-4312-957d-35ed16806e9e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:10:33.807280 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-6b667147-3d13-405b-896e-9a54b3f8c0eb req-13280cc9-9753-44b2-9010-e8c613cdc5fa service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:33.807804 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-6b667147-3d13-405b-896e-9a54b3f8c0eb req-13280cc9-9753-44b2-9010-e8c613cdc5fa service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:33.808244 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-6b667147-3d13-405b-896e-9a54b3f8c0eb req-13280cc9-9753-44b2-9010-e8c613cdc5fa service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:33.811789 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-8adfaece-1528-4a1e-be09-111a0236f0e6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:33.812221 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-8adfaece-1528-4a1e-be09-111a0236f0e6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 4fb48466-ddf3-47f7-bade-b20976690c7f] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:33.820591 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8adfaece-1528-4a1e-be09-111a0236f0e6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:33.821072 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8adfaece-1528-4a1e-be09-111a0236f0e6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:33.821202 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-6b667147-3d13-405b-896e-9a54b3f8c0eb req-13280cc9-9753-44b2-9010-e8c613cdc5fa service nova] Creating event network-vif-plugged:4781df9c-1cb1-4999-a0a2-4e1d4e77d276 for instance 2f1f910a-6135-426a-97a7-570948cf922c on hv-cinder-82099 Oct 11 12:10:33.821499 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8adfaece-1528-4a1e-be09-111a0236f0e6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:33.822192 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8adfaece-1528-4a1e-be09-111a0236f0e6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:33.822660 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8adfaece-1528-4a1e-be09-111a0236f0e6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:33.823076 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8adfaece-1528-4a1e-be09-111a0236f0e6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:33.826262 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-6b667147-3d13-405b-896e-9a54b3f8c0eb req-13280cc9-9753-44b2-9010-e8c613cdc5fa service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034842 Oct 11 12:10:33.827118 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 444/845] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:10:33.838248 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.wsgi [None req-8adfaece-1528-4a1e-be09-111a0236f0e6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] HTTP exception thrown: Instance 4fb48466-ddf3-47f7-bade-b20976690c7f could not be found. Oct 11 12:10:33.839834 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-8adfaece-1528-4a1e-be09-111a0236f0e6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Request method failure captured: Oct 11 12:10:33.839834 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: request: DELETE /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f HTTP/1.1 Oct 11 12:10:33.839834 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept: application/json Oct 11 12:10:33.839834 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept-Encoding: identity Oct 11 12:10:33.839834 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Connection: close Oct 11 12:10:33.839834 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Length: 0 Oct 11 12:10:33.839834 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Type: application/json Oct 11 12:10:33.839834 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Host: 10.222.0.59 Oct 11 12:10:33.839834 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Openstack-System-Scope: None Oct 11 12:10:33.839834 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: User-Agent: python-urllib3/1.26.12 Oct 11 12:10:33.839834 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Auth-Token: gAAAAABjRVrDbBzKTyV9eZUXZryLVe-KpT4WYEHJaER5TFyRAvTSEg5lw7FxKmfGi17rpAnxooOQ2r63AULbLGHHY4hm760kGTTUbeHuyR9-shGVTsiYjly6leZlsPXT8VYCrZ-E0QA-DYApJOgvSEAYz3JHEXcb3Qg12yFjALYOMVuEZNDDhBk Oct 11 12:10:33.839834 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Id: None Oct 11 12:10:33.839834 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Name: None Oct 11 12:10:33.839834 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Identity-Status: Confirmed Oct 11 12:10:33.839834 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Is-Admin-Project: True Oct 11 12:10:33.839834 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Id: default Oct 11 12:10:33.839834 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Name: Default Oct 11 12:10:33.839834 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Id: c83f971a0ae04288a5c6dc87d3370979 Oct 11 12:10:33.839834 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Name: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:10:33.839834 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Role: reader,member Oct 11 12:10:33.839834 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Roles: reader,member Oct 11 12:10:33.841350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:10:33.841350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:10:33.841350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Id: c83f971a0ae04288a5c6dc87d3370979 Oct 11 12:10:33.841350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:10:33.841350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User: tempest-AttachVolumeNegativeTest-1543839758-project Oct 11 12:10:33.841350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Id: default Oct 11 12:10:33.841350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Name: Default Oct 11 12:10:33.841350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Id: 41d3680dda7c4cc8aeb6d086efca0775 Oct 11 12:10:33.841350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Name: tempest-AttachVolumeNegativeTest-1543839758-project Oct 11 12:10:33.841350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: method: > Oct 11 12:10:33.841350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: exception: Instance 4fb48466-ddf3-47f7-bade-b20976690c7f could not be found. Oct 11 12:10:33.841350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: action_args: {'id': '4fb48466-ddf3-47f7-bade-b20976690c7f'} Oct 11 12:10:33.845072 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:10:33.845072 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:10:33.845072 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:10:33.845072 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:10:33.845072 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:10:33.845072 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:10:33.845072 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:10:33.845072 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:10:33.845072 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:10:33.845072 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:10:33.845072 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fb48466-ddf3-47f7-bade-b20976690c7f could not be found. Oct 11 12:10:33.845072 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:10:33.845072 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:10:33.845072 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:10:33.845072 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:10:33.845072 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:10:33.845072 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:10:33.845072 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:10:33.845072 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:10:33.845072 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:10:33.846512 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:10:33.846512 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 12:10:33.846512 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 12:10:33.846512 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 12:10:33.846512 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 12:10:33.846512 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:10:33.846512 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:10:33.846512 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:10:33.846512 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:10:33.846512 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fb48466-ddf3-47f7-bade-b20976690c7f could not be found. Oct 11 12:10:33.846512 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:10:33.846512 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:10:33.846512 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:10:33.846512 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:10:33.846512 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:10:33.846512 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:10:33.846512 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:10:33.846512 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:10:33.846512 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fb48466-ddf3-47f7-bade-b20976690c7f could not be found. Oct 11 12:10:33.846512 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:10:33.847886 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-8adfaece-1528-4a1e-be09-111a0236f0e6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Returning 404 to user: Instance 4fb48466-ddf3-47f7-bade-b20976690c7f could not be found. {{(pid=118994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:10:33.847886 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-8adfaece-1528-4a1e-be09-111a0236f0e6 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "DELETE /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f" status: 404 len: 111 microversion: 2.1 time: 0.033846 Oct 11 12:10:33.847886 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 402/846] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Oct 11 12:10:33 2022] DELETE /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:10:33.850720 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-70f509f1-d832-44db-a02d-01ccfd7bc467 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:33.851401 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-70f509f1-d832-44db-a02d-01ccfd7bc467 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: 4fb48466-ddf3-47f7-bade-b20976690c7f] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:33.857787 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-70f509f1-d832-44db-a02d-01ccfd7bc467 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:33.858330 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-70f509f1-d832-44db-a02d-01ccfd7bc467 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:33.858873 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-70f509f1-d832-44db-a02d-01ccfd7bc467 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:33.859740 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-70f509f1-d832-44db-a02d-01ccfd7bc467 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:33.860251 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-70f509f1-d832-44db-a02d-01ccfd7bc467 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:33.860709 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-70f509f1-d832-44db-a02d-01ccfd7bc467 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:33.875670 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-70f509f1-d832-44db-a02d-01ccfd7bc467 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] HTTP exception thrown: Instance 4fb48466-ddf3-47f7-bade-b20976690c7f could not be found. Oct 11 12:10:33.878007 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-70f509f1-d832-44db-a02d-01ccfd7bc467 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Request method failure captured: Oct 11 12:10:33.878007 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f HTTP/1.1 Oct 11 12:10:33.878007 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 11 12:10:33.878007 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 11 12:10:33.878007 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Connection: close Oct 11 12:10:33.878007 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 11 12:10:33.878007 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 11 12:10:33.878007 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Host: 10.222.0.59 Oct 11 12:10:33.878007 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 11 12:10:33.878007 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 11 12:10:33.878007 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjRVrDbBzKTyV9eZUXZryLVe-KpT4WYEHJaER5TFyRAvTSEg5lw7FxKmfGi17rpAnxooOQ2r63AULbLGHHY4hm760kGTTUbeHuyR9-shGVTsiYjly6leZlsPXT8VYCrZ-E0QA-DYApJOgvSEAYz3JHEXcb3Qg12yFjALYOMVuEZNDDhBk Oct 11 12:10:33.878007 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 11 12:10:33.878007 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 11 12:10:33.878007 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 11 12:10:33.878007 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 11 12:10:33.878007 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 11 12:10:33.878007 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 11 12:10:33.878007 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Id: c83f971a0ae04288a5c6dc87d3370979 Oct 11 12:10:33.878007 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:10:33.878007 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Role: reader,member Oct 11 12:10:33.878007 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Roles: reader,member Oct 11 12:10:33.879664 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:10:33.879664 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:10:33.879664 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Id: c83f971a0ae04288a5c6dc87d3370979 Oct 11 12:10:33.879664 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:10:33.879664 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User: tempest-AttachVolumeNegativeTest-1543839758-project Oct 11 12:10:33.879664 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 11 12:10:33.879664 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 11 12:10:33.879664 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Id: 41d3680dda7c4cc8aeb6d086efca0775 Oct 11 12:10:33.879664 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-AttachVolumeNegativeTest-1543839758-project Oct 11 12:10:33.879664 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: method: > Oct 11 12:10:33.879664 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: exception: Instance 4fb48466-ddf3-47f7-bade-b20976690c7f could not be found. Oct 11 12:10:33.879664 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: action_args: {'id': '4fb48466-ddf3-47f7-bade-b20976690c7f'} Oct 11 12:10:33.880639 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:10:33.880639 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:10:33.880639 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:10:33.880639 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:10:33.880639 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:10:33.880639 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:10:33.880639 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:10:33.880639 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:10:33.880639 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:10:33.880639 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:10:33.880639 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fb48466-ddf3-47f7-bade-b20976690c7f could not be found. Oct 11 12:10:33.880639 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:10:33.880639 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:10:33.880639 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:10:33.880639 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:10:33.880639 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:10:33.880639 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:10:33.880639 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:10:33.880639 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:10:33.880639 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:10:33.881884 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:10:33.881884 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 12:10:33.881884 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 12:10:33.881884 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:10:33.881884 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:10:33.881884 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:10:33.881884 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:10:33.881884 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fb48466-ddf3-47f7-bade-b20976690c7f could not be found. Oct 11 12:10:33.881884 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:10:33.881884 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:10:33.881884 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:10:33.881884 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:10:33.881884 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:10:33.881884 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:10:33.881884 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:10:33.881884 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:10:33.881884 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fb48466-ddf3-47f7-bade-b20976690c7f could not be found. Oct 11 12:10:33.881884 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:10:33.882994 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-70f509f1-d832-44db-a02d-01ccfd7bc467 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Returning 404 to user: Instance 4fb48466-ddf3-47f7-bade-b20976690c7f could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:10:33.882994 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-70f509f1-d832-44db-a02d-01ccfd7bc467 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f" status: 404 len: 111 microversion: 2.1 time: 0.033628 Oct 11 12:10:33.882994 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 445/847] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:33 2022] GET /compute/v2.1/servers/4fb48466-ddf3-47f7-bade-b20976690c7f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:10:33.981774 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-c0939d27-7f15-45b4-a6f2-5efe4d3098af tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:33.982369 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-c0939d27-7f15-45b4-a6f2-5efe4d3098af tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:33.993466 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c0939d27-7f15-45b4-a6f2-5efe4d3098af tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:33.993466 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c0939d27-7f15-45b4-a6f2-5efe4d3098af tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:33.993466 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c0939d27-7f15-45b4-a6f2-5efe4d3098af tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:33.993466 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c0939d27-7f15-45b4-a6f2-5efe4d3098af tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:33.993853 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c0939d27-7f15-45b4-a6f2-5efe4d3098af tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:33.993853 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c0939d27-7f15-45b4-a6f2-5efe4d3098af tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:34.129620 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-c0939d27-7f15-45b4-a6f2-5efe4d3098af tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:34.144491 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-c0939d27-7f15-45b4-a6f2-5efe4d3098af tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:34.146790 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-c0939d27-7f15-45b4-a6f2-5efe4d3098af tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:34.148666 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-c0939d27-7f15-45b4-a6f2-5efe4d3098af tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1810 microversion: 2.20 time: 0.170777 Oct 11 12:10:34.149568 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 403/848] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:10:33 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:10:34.462678 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-db418ce0-51fb-4683-ba3f-9982c2091644 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:34.463261 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-db418ce0-51fb-4683-ba3f-9982c2091644 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:34.469530 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-db418ce0-51fb-4683-ba3f-9982c2091644 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:34.470007 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-db418ce0-51fb-4683-ba3f-9982c2091644 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:34.470408 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-db418ce0-51fb-4683-ba3f-9982c2091644 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:34.471145 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-db418ce0-51fb-4683-ba3f-9982c2091644 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:34.471587 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-db418ce0-51fb-4683-ba3f-9982c2091644 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:34.472021 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-db418ce0-51fb-4683-ba3f-9982c2091644 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:34.606741 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-db418ce0-51fb-4683-ba3f-9982c2091644 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:34.615112 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-db418ce0-51fb-4683-ba3f-9982c2091644 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1568 microversion: 2.1 time: 0.156281 Oct 11 12:10:34.615644 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 446/849] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:34 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:35.038335 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-9ee7ab32-773b-4556-a0dd-3bbe39f84024 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:35.038862 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-9ee7ab32-773b-4556-a0dd-3bbe39f84024 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:35.045684 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9ee7ab32-773b-4556-a0dd-3bbe39f84024 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:35.046249 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9ee7ab32-773b-4556-a0dd-3bbe39f84024 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:35.046708 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9ee7ab32-773b-4556-a0dd-3bbe39f84024 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:35.047395 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9ee7ab32-773b-4556-a0dd-3bbe39f84024 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:35.047839 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9ee7ab32-773b-4556-a0dd-3bbe39f84024 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:35.048254 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9ee7ab32-773b-4556-a0dd-3bbe39f84024 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:35.062117 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.wsgi [None req-9ee7ab32-773b-4556-a0dd-3bbe39f84024 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] HTTP exception thrown: Instance ac5dba27-8c1b-4760-ad6f-7ab81244e186 could not be found. Oct 11 12:10:35.063712 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-9ee7ab32-773b-4556-a0dd-3bbe39f84024 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Request method failure captured: Oct 11 12:10:35.063712 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: request: DELETE /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 HTTP/1.1 Oct 11 12:10:35.063712 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept: application/json Oct 11 12:10:35.063712 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept-Encoding: identity Oct 11 12:10:35.063712 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Connection: close Oct 11 12:10:35.063712 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Length: 0 Oct 11 12:10:35.063712 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Type: application/json Oct 11 12:10:35.063712 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Host: 10.222.0.59 Oct 11 12:10:35.063712 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Openstack-System-Scope: None Oct 11 12:10:35.063712 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: User-Agent: python-urllib3/1.26.12 Oct 11 12:10:35.063712 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Auth-Token: gAAAAABjRVrDbBzKTyV9eZUXZryLVe-KpT4WYEHJaER5TFyRAvTSEg5lw7FxKmfGi17rpAnxooOQ2r63AULbLGHHY4hm760kGTTUbeHuyR9-shGVTsiYjly6leZlsPXT8VYCrZ-E0QA-DYApJOgvSEAYz3JHEXcb3Qg12yFjALYOMVuEZNDDhBk Oct 11 12:10:35.063712 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Id: None Oct 11 12:10:35.063712 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Name: None Oct 11 12:10:35.063712 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Identity-Status: Confirmed Oct 11 12:10:35.063712 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Is-Admin-Project: True Oct 11 12:10:35.063712 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Id: default Oct 11 12:10:35.063712 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Name: Default Oct 11 12:10:35.063712 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Id: c83f971a0ae04288a5c6dc87d3370979 Oct 11 12:10:35.063712 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Name: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:10:35.063712 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Role: reader,member Oct 11 12:10:35.063712 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Roles: reader,member Oct 11 12:10:35.065096 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:10:35.065096 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:10:35.065096 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Id: c83f971a0ae04288a5c6dc87d3370979 Oct 11 12:10:35.065096 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:10:35.065096 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User: tempest-AttachVolumeNegativeTest-1543839758-project Oct 11 12:10:35.065096 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Id: default Oct 11 12:10:35.065096 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Name: Default Oct 11 12:10:35.065096 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Id: 41d3680dda7c4cc8aeb6d086efca0775 Oct 11 12:10:35.065096 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Name: tempest-AttachVolumeNegativeTest-1543839758-project Oct 11 12:10:35.065096 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: method: > Oct 11 12:10:35.065096 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: exception: Instance ac5dba27-8c1b-4760-ad6f-7ab81244e186 could not be found. Oct 11 12:10:35.065096 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: action_args: {'id': 'ac5dba27-8c1b-4760-ad6f-7ab81244e186'} Oct 11 12:10:35.065900 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:10:35.065900 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:10:35.065900 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:10:35.065900 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:10:35.065900 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:10:35.065900 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:10:35.065900 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:10:35.065900 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:10:35.065900 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:10:35.065900 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:10:35.065900 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac5dba27-8c1b-4760-ad6f-7ab81244e186 could not be found. Oct 11 12:10:35.065900 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:10:35.065900 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:10:35.065900 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:10:35.065900 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:10:35.065900 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:10:35.065900 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:10:35.065900 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:10:35.065900 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:10:35.065900 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:10:35.067420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:10:35.067420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 12:10:35.067420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 12:10:35.067420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 12:10:35.067420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 12:10:35.067420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:10:35.067420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:10:35.067420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:10:35.067420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:10:35.067420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac5dba27-8c1b-4760-ad6f-7ab81244e186 could not be found. Oct 11 12:10:35.067420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:10:35.067420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:10:35.067420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:10:35.067420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:10:35.067420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:10:35.067420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:10:35.067420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:10:35.067420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:10:35.067420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac5dba27-8c1b-4760-ad6f-7ab81244e186 could not be found. Oct 11 12:10:35.067420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:10:35.068919 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-9ee7ab32-773b-4556-a0dd-3bbe39f84024 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Returning 404 to user: Instance ac5dba27-8c1b-4760-ad6f-7ab81244e186 could not be found. {{(pid=118994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:10:35.068919 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-9ee7ab32-773b-4556-a0dd-3bbe39f84024 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 404 len: 111 microversion: 2.1 time: 0.030638 Oct 11 12:10:35.068919 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 404/850] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Oct 11 12:10:35 2022] DELETE /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:10:35.073837 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7597b95b-f84c-49b7-b7dc-7d622c2b0144 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:35.074450 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7597b95b-f84c-49b7-b7dc-7d622c2b0144 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] [instance: ac5dba27-8c1b-4760-ad6f-7ab81244e186] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:35.081491 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7597b95b-f84c-49b7-b7dc-7d622c2b0144 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:35.081967 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7597b95b-f84c-49b7-b7dc-7d622c2b0144 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:35.082395 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7597b95b-f84c-49b7-b7dc-7d622c2b0144 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:35.083201 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7597b95b-f84c-49b7-b7dc-7d622c2b0144 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:35.083658 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7597b95b-f84c-49b7-b7dc-7d622c2b0144 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:35.084088 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7597b95b-f84c-49b7-b7dc-7d622c2b0144 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:35.097631 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-7597b95b-f84c-49b7-b7dc-7d622c2b0144 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] HTTP exception thrown: Instance ac5dba27-8c1b-4760-ad6f-7ab81244e186 could not be found. Oct 11 12:10:35.099209 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7597b95b-f84c-49b7-b7dc-7d622c2b0144 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Request method failure captured: Oct 11 12:10:35.099209 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 HTTP/1.1 Oct 11 12:10:35.099209 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 11 12:10:35.099209 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 11 12:10:35.099209 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Connection: close Oct 11 12:10:35.099209 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 11 12:10:35.099209 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 11 12:10:35.099209 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Host: 10.222.0.59 Oct 11 12:10:35.099209 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 11 12:10:35.099209 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 11 12:10:35.099209 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjRVrDbBzKTyV9eZUXZryLVe-KpT4WYEHJaER5TFyRAvTSEg5lw7FxKmfGi17rpAnxooOQ2r63AULbLGHHY4hm760kGTTUbeHuyR9-shGVTsiYjly6leZlsPXT8VYCrZ-E0QA-DYApJOgvSEAYz3JHEXcb3Qg12yFjALYOMVuEZNDDhBk Oct 11 12:10:35.099209 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 11 12:10:35.099209 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 11 12:10:35.099209 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 11 12:10:35.099209 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 11 12:10:35.099209 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 11 12:10:35.099209 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 11 12:10:35.099209 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Id: c83f971a0ae04288a5c6dc87d3370979 Oct 11 12:10:35.099209 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:10:35.099209 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Role: reader,member Oct 11 12:10:35.099209 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Roles: reader,member Oct 11 12:10:35.100735 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/c83f971a0ae04288a5c6dc87d3370979"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:10:35.100735 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:10:35.100735 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Id: c83f971a0ae04288a5c6dc87d3370979 Oct 11 12:10:35.100735 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1543839758 Oct 11 12:10:35.100735 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User: tempest-AttachVolumeNegativeTest-1543839758-project Oct 11 12:10:35.100735 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 11 12:10:35.100735 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 11 12:10:35.100735 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Id: 41d3680dda7c4cc8aeb6d086efca0775 Oct 11 12:10:35.100735 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-AttachVolumeNegativeTest-1543839758-project Oct 11 12:10:35.100735 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: method: > Oct 11 12:10:35.100735 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: exception: Instance ac5dba27-8c1b-4760-ad6f-7ab81244e186 could not be found. Oct 11 12:10:35.100735 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: action_args: {'id': 'ac5dba27-8c1b-4760-ad6f-7ab81244e186'} Oct 11 12:10:35.101620 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:10:35.101620 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:10:35.101620 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:10:35.101620 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:10:35.101620 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:10:35.101620 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:10:35.101620 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:10:35.101620 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:10:35.101620 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:10:35.101620 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:10:35.101620 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ac5dba27-8c1b-4760-ad6f-7ab81244e186 could not be found. Oct 11 12:10:35.101620 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:10:35.101620 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:10:35.101620 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:10:35.101620 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:10:35.101620 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:10:35.101620 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:10:35.101620 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:10:35.101620 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:10:35.101620 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:10:35.103188 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:10:35.103188 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 12:10:35.103188 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 12:10:35.103188 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:10:35.103188 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:10:35.103188 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:10:35.103188 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:10:35.103188 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ac5dba27-8c1b-4760-ad6f-7ab81244e186 could not be found. Oct 11 12:10:35.103188 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:10:35.103188 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:10:35.103188 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:10:35.103188 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:10:35.103188 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:10:35.103188 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:10:35.103188 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:10:35.103188 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:10:35.103188 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ac5dba27-8c1b-4760-ad6f-7ab81244e186 could not be found. Oct 11 12:10:35.103188 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:10:35.104488 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7597b95b-f84c-49b7-b7dc-7d622c2b0144 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] Returning 404 to user: Instance ac5dba27-8c1b-4760-ad6f-7ab81244e186 could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:10:35.104488 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7597b95b-f84c-49b7-b7dc-7d622c2b0144 tempest-AttachVolumeNegativeTest-1543839758 tempest-AttachVolumeNegativeTest-1543839758-project] 10.222.0.59 "GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186" status: 404 len: 111 microversion: 2.1 time: 0.030728 Oct 11 12:10:35.104488 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 447/851] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:35 2022] GET /compute/v2.1/servers/ac5dba27-8c1b-4760-ad6f-7ab81244e186 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 12:10:35.175670 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-0bcb81c6-2287-4182-8c6a-1d9458751485 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:35.176404 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-0bcb81c6-2287-4182-8c6a-1d9458751485 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:35.182488 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0bcb81c6-2287-4182-8c6a-1d9458751485 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:35.183028 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0bcb81c6-2287-4182-8c6a-1d9458751485 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:35.183458 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0bcb81c6-2287-4182-8c6a-1d9458751485 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:35.184149 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0bcb81c6-2287-4182-8c6a-1d9458751485 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:35.184593 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0bcb81c6-2287-4182-8c6a-1d9458751485 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:35.185010 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0bcb81c6-2287-4182-8c6a-1d9458751485 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:35.409782 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-0bcb81c6-2287-4182-8c6a-1d9458751485 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:35.418913 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-0bcb81c6-2287-4182-8c6a-1d9458751485 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:35.420322 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-0bcb81c6-2287-4182-8c6a-1d9458751485 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:35.421530 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-0bcb81c6-2287-4182-8c6a-1d9458751485 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1810 microversion: 2.20 time: 0.250038 Oct 11 12:10:35.422088 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 405/852] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:10:35 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1810 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:10:35.637441 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8cc8f2e7-5481-4878-a6d2-3eb491c88c97 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:35.638390 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8cc8f2e7-5481-4878-a6d2-3eb491c88c97 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:35.645019 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8cc8f2e7-5481-4878-a6d2-3eb491c88c97 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:35.645491 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8cc8f2e7-5481-4878-a6d2-3eb491c88c97 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:35.645913 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8cc8f2e7-5481-4878-a6d2-3eb491c88c97 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:35.646649 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8cc8f2e7-5481-4878-a6d2-3eb491c88c97 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:35.647098 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8cc8f2e7-5481-4878-a6d2-3eb491c88c97 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:35.647518 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8cc8f2e7-5481-4878-a6d2-3eb491c88c97 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:35.779667 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8cc8f2e7-5481-4878-a6d2-3eb491c88c97 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:35.787505 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8cc8f2e7-5481-4878-a6d2-3eb491c88c97 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1568 microversion: 2.1 time: 0.154151 Oct 11 12:10:35.788099 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 448/853] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:35 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:10:36.447692 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-d4fd6496-06a3-4a35-8238-3dff7e2a7973 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:36.448619 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-d4fd6496-06a3-4a35-8238-3dff7e2a7973 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:36.456684 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d4fd6496-06a3-4a35-8238-3dff7e2a7973 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:36.457230 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d4fd6496-06a3-4a35-8238-3dff7e2a7973 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:36.458315 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d4fd6496-06a3-4a35-8238-3dff7e2a7973 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:36.459219 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d4fd6496-06a3-4a35-8238-3dff7e2a7973 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:36.459901 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d4fd6496-06a3-4a35-8238-3dff7e2a7973 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:36.460809 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d4fd6496-06a3-4a35-8238-3dff7e2a7973 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:36.652394 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-d4fd6496-06a3-4a35-8238-3dff7e2a7973 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:36.663260 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-d4fd6496-06a3-4a35-8238-3dff7e2a7973 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:36.664984 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-d4fd6496-06a3-4a35-8238-3dff7e2a7973 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:36.666305 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-d4fd6496-06a3-4a35-8238-3dff7e2a7973 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1810 microversion: 2.20 time: 0.222558 Oct 11 12:10:36.666919 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 406/854] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:10:36 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1810 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:10:36.810486 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-387b0249-7cf6-4ac1-a148-0c53264e9c10 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:36.811126 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-387b0249-7cf6-4ac1-a148-0c53264e9c10 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:36.818011 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-387b0249-7cf6-4ac1-a148-0c53264e9c10 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:36.818496 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-387b0249-7cf6-4ac1-a148-0c53264e9c10 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:36.818965 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-387b0249-7cf6-4ac1-a148-0c53264e9c10 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:36.819635 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-387b0249-7cf6-4ac1-a148-0c53264e9c10 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:36.820081 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-387b0249-7cf6-4ac1-a148-0c53264e9c10 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:36.820495 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-387b0249-7cf6-4ac1-a148-0c53264e9c10 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:36.983452 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-387b0249-7cf6-4ac1-a148-0c53264e9c10 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:36.992001 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-387b0249-7cf6-4ac1-a148-0c53264e9c10 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1568 microversion: 2.1 time: 0.185373 Oct 11 12:10:36.993057 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 449/855] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:36 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1568 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:37.693122 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-2260e182-0128-47b1-8799-f5dec39fb241 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:37.693730 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-2260e182-0128-47b1-8799-f5dec39fb241 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:37.701216 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2260e182-0128-47b1-8799-f5dec39fb241 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:37.701736 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2260e182-0128-47b1-8799-f5dec39fb241 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:37.702228 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2260e182-0128-47b1-8799-f5dec39fb241 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:37.703095 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2260e182-0128-47b1-8799-f5dec39fb241 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:37.703574 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2260e182-0128-47b1-8799-f5dec39fb241 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:37.704653 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2260e182-0128-47b1-8799-f5dec39fb241 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:37.849113 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-20aed9be-e860-48e5-b449-e213ac9d544e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:37.851894 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-20aed9be-e860-48e5-b449-e213ac9d544e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: 685030b8-7128-4366-a241-55617cbe5b1f] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:37.863022 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-20aed9be-e860-48e5-b449-e213ac9d544e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:37.863523 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-20aed9be-e860-48e5-b449-e213ac9d544e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:37.863944 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-20aed9be-e860-48e5-b449-e213ac9d544e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:37.864652 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-20aed9be-e860-48e5-b449-e213ac9d544e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:37.865097 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-20aed9be-e860-48e5-b449-e213ac9d544e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:37.867190 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-20aed9be-e860-48e5-b449-e213ac9d544e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:37.907373 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-20aed9be-e860-48e5-b449-e213ac9d544e tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061268 Oct 11 12:10:37.908296 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 450/856] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Oct 11 12:10:37 2022] GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:10:37.928759 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-2260e182-0128-47b1-8799-f5dec39fb241 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:37.935704 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-22d397a0-4535-4e78-b9a0-0c7ce92a4622 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:37.936070 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-22d397a0-4535-4e78-b9a0-0c7ce92a4622 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: 685030b8-7128-4366-a241-55617cbe5b1f] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:37.940393 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-2260e182-0128-47b1-8799-f5dec39fb241 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:37.942516 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-22d397a0-4535-4e78-b9a0-0c7ce92a4622 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:37.943031 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-22d397a0-4535-4e78-b9a0-0c7ce92a4622 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:37.943461 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-22d397a0-4535-4e78-b9a0-0c7ce92a4622 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:37.944163 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-22d397a0-4535-4e78-b9a0-0c7ce92a4622 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:37.945631 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-2260e182-0128-47b1-8799-f5dec39fb241 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:37.947122 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-22d397a0-4535-4e78-b9a0-0c7ce92a4622 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:37.947323 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-2260e182-0128-47b1-8799-f5dec39fb241 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1797 microversion: 2.20 time: 0.258179 Oct 11 12:10:37.947598 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-22d397a0-4535-4e78-b9a0-0c7ce92a4622 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:37.948232 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 407/857] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:10:37 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1797 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:10:37.989095 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-22d397a0-4535-4e78-b9a0-0c7ce92a4622 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f/os-volume_attachments/cf869940-d7ef-499c-959c-615a0f887458" status: 200 len: 194 microversion: 2.1 time: 0.072396 Oct 11 12:10:37.989938 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 451/858] 10.222.0.59 () {58 vars in 1413 bytes} [Tue Oct 11 12:10:37 2022] GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f/os-volume_attachments/cf869940-d7ef-499c-959c-615a0f887458 => generated 194 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:10:38.018195 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-28657181-d68f-41fd-8854-1ac6c81d4061 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:38.018840 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-28657181-d68f-41fd-8854-1ac6c81d4061 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:38.025671 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-28657181-d68f-41fd-8854-1ac6c81d4061 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:38.026153 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-28657181-d68f-41fd-8854-1ac6c81d4061 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:38.026595 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-28657181-d68f-41fd-8854-1ac6c81d4061 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:38.027486 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-28657181-d68f-41fd-8854-1ac6c81d4061 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:38.028082 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-28657181-d68f-41fd-8854-1ac6c81d4061 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:38.028687 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-28657181-d68f-41fd-8854-1ac6c81d4061 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:38.210187 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-28657181-d68f-41fd-8854-1ac6c81d4061 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:38.217104 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-28657181-d68f-41fd-8854-1ac6c81d4061 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1568 microversion: 2.1 time: 0.204325 Oct 11 12:10:38.218586 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 408/859] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:38 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1568 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:39.244521 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-4f08e8ae-6dd4-42f0-97b8-1aa81ed938c8 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:39.245133 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-4f08e8ae-6dd4-42f0-97b8-1aa81ed938c8 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:39.251882 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f08e8ae-6dd4-42f0-97b8-1aa81ed938c8 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:39.252487 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f08e8ae-6dd4-42f0-97b8-1aa81ed938c8 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:39.253017 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f08e8ae-6dd4-42f0-97b8-1aa81ed938c8 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:39.253773 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f08e8ae-6dd4-42f0-97b8-1aa81ed938c8 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:39.254222 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f08e8ae-6dd4-42f0-97b8-1aa81ed938c8 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:39.254735 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4f08e8ae-6dd4-42f0-97b8-1aa81ed938c8 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:39.393753 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-4f08e8ae-6dd4-42f0-97b8-1aa81ed938c8 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:39.398346 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-4f08e8ae-6dd4-42f0-97b8-1aa81ed938c8 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1568 microversion: 2.1 time: 0.157522 Oct 11 12:10:39.406446 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 452/860] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:39 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:39.442800 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-42dace88-e8a1-4f4b-82fc-d25477f3b67a tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bcab2c9e-9f70-4341-9c6f-119a04d62599"}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:10:39.445211 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-42dace88-e8a1-4f4b-82fc-d25477f3b67a tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: 685030b8-7128-4366-a241-55617cbe5b1f] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:39.451726 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-42dace88-e8a1-4f4b-82fc-d25477f3b67a tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:39.452270 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-42dace88-e8a1-4f4b-82fc-d25477f3b67a tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:39.452701 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-42dace88-e8a1-4f4b-82fc-d25477f3b67a tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:39.453393 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-42dace88-e8a1-4f4b-82fc-d25477f3b67a tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:39.453837 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-42dace88-e8a1-4f4b-82fc-d25477f3b67a tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:39.454252 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-42dace88-e8a1-4f4b-82fc-d25477f3b67a tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:40.421591 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-be2c1572-d0a2-4991-8e0f-0d7460370f75 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:40.422890 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-be2c1572-d0a2-4991-8e0f-0d7460370f75 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:40.431007 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-be2c1572-d0a2-4991-8e0f-0d7460370f75 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:40.431549 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-be2c1572-d0a2-4991-8e0f-0d7460370f75 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:40.431891 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-be2c1572-d0a2-4991-8e0f-0d7460370f75 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:40.432581 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-be2c1572-d0a2-4991-8e0f-0d7460370f75 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:40.433018 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-be2c1572-d0a2-4991-8e0f-0d7460370f75 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:40.433734 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-be2c1572-d0a2-4991-8e0f-0d7460370f75 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:40.558133 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:10:40.570432 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-42dace88-e8a1-4f4b-82fc-d25477f3b67a tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "POST /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.131448 Oct 11 12:10:40.571107 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 409/861] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Oct 11 12:10:39 2022] POST /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f/os-volume_attachments => generated 194 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:10:40.596560 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-be2c1572-d0a2-4991-8e0f-0d7460370f75 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:40.604767 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-be2c1572-d0a2-4991-8e0f-0d7460370f75 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1568 microversion: 2.1 time: 0.187209 Oct 11 12:10:40.605333 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 453/862] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:40 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:41.629083 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-af6996cf-0317-4355-8e1d-d0ed6a78a5ec tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:41.629779 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-af6996cf-0317-4355-8e1d-d0ed6a78a5ec tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:41.637818 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-af6996cf-0317-4355-8e1d-d0ed6a78a5ec tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:41.638286 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-af6996cf-0317-4355-8e1d-d0ed6a78a5ec tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:41.638949 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-af6996cf-0317-4355-8e1d-d0ed6a78a5ec tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:41.639650 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-af6996cf-0317-4355-8e1d-d0ed6a78a5ec tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:41.640203 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-af6996cf-0317-4355-8e1d-d0ed6a78a5ec tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:41.640620 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-af6996cf-0317-4355-8e1d-d0ed6a78a5ec tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:41.797941 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-af6996cf-0317-4355-8e1d-d0ed6a78a5ec tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:41.805961 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-af6996cf-0317-4355-8e1d-d0ed6a78a5ec tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1569 microversion: 2.1 time: 0.181671 Oct 11 12:10:41.806527 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 410/863] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:41 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:41.828210 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-68f93870-9d0b-47cc-bd56-06b2820518dd tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:10:41.828801 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-68f93870-9d0b-47cc-bd56-06b2820518dd tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:41.835202 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-68f93870-9d0b-47cc-bd56-06b2820518dd tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:41.835677 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-68f93870-9d0b-47cc-bd56-06b2820518dd tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:41.836104 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-68f93870-9d0b-47cc-bd56-06b2820518dd tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:41.836799 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-68f93870-9d0b-47cc-bd56-06b2820518dd tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:41.837277 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-68f93870-9d0b-47cc-bd56-06b2820518dd tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:41.837695 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-68f93870-9d0b-47cc-bd56-06b2820518dd tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:41.883960 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-68f93870-9d0b-47cc-bd56-06b2820518dd tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118995) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 11 12:10:41.963699 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-68f93870-9d0b-47cc-bd56-06b2820518dd tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "POST /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91/action" status: 202 len: 0 microversion: 2.1 time: 0.139426 Oct 11 12:10:41.964488 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 454/864] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Oct 11 12:10:41 2022] POST /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91/action => generated 0 bytes in 141 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 12:10:41.972806 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-a88034a0-c673-4827-87f7-cd58a4524fdc tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:41.973350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-a88034a0-c673-4827-87f7-cd58a4524fdc tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:41.980251 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a88034a0-c673-4827-87f7-cd58a4524fdc tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:41.980734 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a88034a0-c673-4827-87f7-cd58a4524fdc tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:41.981303 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a88034a0-c673-4827-87f7-cd58a4524fdc tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:41.981855 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a88034a0-c673-4827-87f7-cd58a4524fdc tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:41.982300 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a88034a0-c673-4827-87f7-cd58a4524fdc tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:41.982788 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a88034a0-c673-4827-87f7-cd58a4524fdc tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:42.129933 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-a88034a0-c673-4827-87f7-cd58a4524fdc tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:42.138039 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-a88034a0-c673-4827-87f7-cd58a4524fdc tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1577 microversion: 2.1 time: 0.169107 Oct 11 12:10:42.138716 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 411/865] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:41 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1577 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:43.162159 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2ca19962-8683-479d-87df-713c1e8b1cb5 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:43.162818 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2ca19962-8683-479d-87df-713c1e8b1cb5 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:43.169401 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2ca19962-8683-479d-87df-713c1e8b1cb5 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:43.170048 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2ca19962-8683-479d-87df-713c1e8b1cb5 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:43.170461 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2ca19962-8683-479d-87df-713c1e8b1cb5 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:43.171208 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2ca19962-8683-479d-87df-713c1e8b1cb5 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:43.171742 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2ca19962-8683-479d-87df-713c1e8b1cb5 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:43.172158 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2ca19962-8683-479d-87df-713c1e8b1cb5 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:43.307295 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2ca19962-8683-479d-87df-713c1e8b1cb5 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:43.315312 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2ca19962-8683-479d-87df-713c1e8b1cb5 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1519 microversion: 2.1 time: 0.157798 Oct 11 12:10:43.315857 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 455/866] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:43 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:44.337824 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-c7aabaf0-8fd0-4dbb-b0ea-87821972ce1d tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:44.338434 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-c7aabaf0-8fd0-4dbb-b0ea-87821972ce1d tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:44.345340 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c7aabaf0-8fd0-4dbb-b0ea-87821972ce1d tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:44.345819 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c7aabaf0-8fd0-4dbb-b0ea-87821972ce1d tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:44.346242 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c7aabaf0-8fd0-4dbb-b0ea-87821972ce1d tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:44.346966 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c7aabaf0-8fd0-4dbb-b0ea-87821972ce1d tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:44.347442 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c7aabaf0-8fd0-4dbb-b0ea-87821972ce1d tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:44.347859 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c7aabaf0-8fd0-4dbb-b0ea-87821972ce1d tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:44.491509 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-c7aabaf0-8fd0-4dbb-b0ea-87821972ce1d tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:44.499990 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-c7aabaf0-8fd0-4dbb-b0ea-87821972ce1d tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1519 microversion: 2.1 time: 0.166008 Oct 11 12:10:44.500775 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 412/867] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:44 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:45.523849 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-81c13aaf-ce4f-47ed-b0b7-6cf6097fba99 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:45.524708 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-81c13aaf-ce4f-47ed-b0b7-6cf6097fba99 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:45.531480 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-81c13aaf-ce4f-47ed-b0b7-6cf6097fba99 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:45.531985 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-81c13aaf-ce4f-47ed-b0b7-6cf6097fba99 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:45.532399 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-81c13aaf-ce4f-47ed-b0b7-6cf6097fba99 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:45.533302 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-81c13aaf-ce4f-47ed-b0b7-6cf6097fba99 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:45.533750 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-81c13aaf-ce4f-47ed-b0b7-6cf6097fba99 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:45.534193 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-81c13aaf-ce4f-47ed-b0b7-6cf6097fba99 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:45.668820 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-81c13aaf-ce4f-47ed-b0b7-6cf6097fba99 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:45.677098 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-81c13aaf-ce4f-47ed-b0b7-6cf6097fba99 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1519 microversion: 2.1 time: 0.157068 Oct 11 12:10:45.677639 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 456/868] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:45 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1519 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:10:46.701385 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-e1bc4a3f-2447-4be6-95ab-ef7c58b90382 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:46.701938 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-e1bc4a3f-2447-4be6-95ab-ef7c58b90382 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:46.709163 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e1bc4a3f-2447-4be6-95ab-ef7c58b90382 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:46.709643 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e1bc4a3f-2447-4be6-95ab-ef7c58b90382 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:46.710074 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e1bc4a3f-2447-4be6-95ab-ef7c58b90382 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:46.710810 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e1bc4a3f-2447-4be6-95ab-ef7c58b90382 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:46.711222 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e1bc4a3f-2447-4be6-95ab-ef7c58b90382 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:46.711673 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e1bc4a3f-2447-4be6-95ab-ef7c58b90382 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:46.851068 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-e1bc4a3f-2447-4be6-95ab-ef7c58b90382 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:46.859544 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-e1bc4a3f-2447-4be6-95ab-ef7c58b90382 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1519 microversion: 2.1 time: 0.162300 Oct 11 12:10:46.860110 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 413/869] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:46 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:47.174617 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-cc410bf3-c16f-4437-a71c-95e81ac1ad60 req-e3f3883e-4329-4039-b995-b97cacd014ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ddb150d-886c-46f4-9c3d-0722148d7d91", "name": "network-vif-unplugged", "status": "completed", "tag": "473109ef-4d1a-4e60-84ad-152e53b93a74"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:10:47.185470 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-cc410bf3-c16f-4437-a71c-95e81ac1ad60 req-e3f3883e-4329-4039-b995-b97cacd014ad service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:47.186792 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-cc410bf3-c16f-4437-a71c-95e81ac1ad60 req-e3f3883e-4329-4039-b995-b97cacd014ad service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:47.187233 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-cc410bf3-c16f-4437-a71c-95e81ac1ad60 req-e3f3883e-4329-4039-b995-b97cacd014ad service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:47.201844 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.compute.server_external_events [req-cc410bf3-c16f-4437-a71c-95e81ac1ad60 req-e3f3883e-4329-4039-b995-b97cacd014ad service nova] Unable to find a host for instance 5ddb150d-886c-46f4-9c3d-0722148d7d91. Dropping event network-vif-unplugged {{(pid=118995) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 11 12:10:47.202786 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-cc410bf3-c16f-4437-a71c-95e81ac1ad60 req-e3f3883e-4329-4039-b995-b97cacd014ad service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032243 Oct 11 12:10:47.203360 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 457/870] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 11 12:10:47.884158 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-9ac2ea2b-dde8-438e-9728-cc9075bb060b tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:47.884833 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-9ac2ea2b-dde8-438e-9728-cc9075bb060b tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:47.893663 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9ac2ea2b-dde8-438e-9728-cc9075bb060b tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:47.894140 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9ac2ea2b-dde8-438e-9728-cc9075bb060b tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:47.894600 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9ac2ea2b-dde8-438e-9728-cc9075bb060b tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:47.895276 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9ac2ea2b-dde8-438e-9728-cc9075bb060b tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:47.895768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9ac2ea2b-dde8-438e-9728-cc9075bb060b tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:47.896165 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9ac2ea2b-dde8-438e-9728-cc9075bb060b tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:48.040595 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-9ac2ea2b-dde8-438e-9728-cc9075bb060b tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:48.050350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-9ac2ea2b-dde8-438e-9728-cc9075bb060b tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1519 microversion: 2.1 time: 0.171145 Oct 11 12:10:48.050973 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 414/871] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:47 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1519 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:49.074442 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c2a04248-40b5-402b-8444-5e314e6b9eb3 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:49.075094 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c2a04248-40b5-402b-8444-5e314e6b9eb3 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:49.081722 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c2a04248-40b5-402b-8444-5e314e6b9eb3 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:49.082206 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c2a04248-40b5-402b-8444-5e314e6b9eb3 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:49.082662 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c2a04248-40b5-402b-8444-5e314e6b9eb3 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:49.083337 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c2a04248-40b5-402b-8444-5e314e6b9eb3 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:49.083779 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c2a04248-40b5-402b-8444-5e314e6b9eb3 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:49.084191 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c2a04248-40b5-402b-8444-5e314e6b9eb3 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:49.086825 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:10:49.224109 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c2a04248-40b5-402b-8444-5e314e6b9eb3 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:49.236461 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c2a04248-40b5-402b-8444-5e314e6b9eb3 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1519 microversion: 2.1 time: 0.165769 Oct 11 12:10:49.237157 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 458/872] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:49 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:50.261162 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-15f968ab-5259-4786-bbe7-6cc001f9e754 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:50.261748 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-15f968ab-5259-4786-bbe7-6cc001f9e754 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:50.269346 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-15f968ab-5259-4786-bbe7-6cc001f9e754 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:50.270020 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-15f968ab-5259-4786-bbe7-6cc001f9e754 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:50.270446 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-15f968ab-5259-4786-bbe7-6cc001f9e754 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:50.271208 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-15f968ab-5259-4786-bbe7-6cc001f9e754 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:50.271646 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-15f968ab-5259-4786-bbe7-6cc001f9e754 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:50.272074 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-15f968ab-5259-4786-bbe7-6cc001f9e754 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:50.319229 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-642295ff-1d47-4817-8632-ac90ee691419 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:50.321384 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-642295ff-1d47-4817-8632-ac90ee691419 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: 685030b8-7128-4366-a241-55617cbe5b1f] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:50.328133 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-642295ff-1d47-4817-8632-ac90ee691419 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:50.328616 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-642295ff-1d47-4817-8632-ac90ee691419 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:50.329038 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-642295ff-1d47-4817-8632-ac90ee691419 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:50.329726 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-642295ff-1d47-4817-8632-ac90ee691419 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:50.330218 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-642295ff-1d47-4817-8632-ac90ee691419 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:50.330686 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-642295ff-1d47-4817-8632-ac90ee691419 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:50.361340 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-642295ff-1d47-4817-8632-ac90ee691419 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046375 Oct 11 12:10:50.361924 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 459/873] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Oct 11 12:10:50 2022] GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 12:10:50.411836 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-15f968ab-5259-4786-bbe7-6cc001f9e754 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:50.419541 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-15f968ab-5259-4786-bbe7-6cc001f9e754 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1519 microversion: 2.1 time: 0.163411 Oct 11 12:10:50.420154 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 415/874] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:50 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1519 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:50.513533 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3e55eebb-7475-4d8f-90ff-4ddf340896cf tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:50.514049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-3e55eebb-7475-4d8f-90ff-4ddf340896cf tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: 685030b8-7128-4366-a241-55617cbe5b1f] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:50.521105 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3e55eebb-7475-4d8f-90ff-4ddf340896cf tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:50.521632 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3e55eebb-7475-4d8f-90ff-4ddf340896cf tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:50.522382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3e55eebb-7475-4d8f-90ff-4ddf340896cf tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:50.523164 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3e55eebb-7475-4d8f-90ff-4ddf340896cf tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:50.523621 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3e55eebb-7475-4d8f-90ff-4ddf340896cf tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:50.524025 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3e55eebb-7475-4d8f-90ff-4ddf340896cf tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:50.562027 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-3e55eebb-7475-4d8f-90ff-4ddf340896cf tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f/os-volume_attachments/cf869940-d7ef-499c-959c-615a0f887458" status: 200 len: 194 microversion: 2.1 time: 0.052856 Oct 11 12:10:50.562622 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 460/875] 10.222.0.59 () {58 vars in 1413 bytes} [Tue Oct 11 12:10:50 2022] GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f/os-volume_attachments/cf869940-d7ef-499c-959c-615a0f887458 => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:10:50.573180 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-7d463ee8-9295-471d-9c96-5c685de46943 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:50.573647 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-7d463ee8-9295-471d-9c96-5c685de46943 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: 685030b8-7128-4366-a241-55617cbe5b1f] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:50.579577 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7d463ee8-9295-471d-9c96-5c685de46943 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:50.580050 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7d463ee8-9295-471d-9c96-5c685de46943 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:50.580542 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7d463ee8-9295-471d-9c96-5c685de46943 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:50.581230 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7d463ee8-9295-471d-9c96-5c685de46943 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:50.581668 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7d463ee8-9295-471d-9c96-5c685de46943 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:50.582081 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7d463ee8-9295-471d-9c96-5c685de46943 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:50.665860 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.objects.instance [None req-7d463ee8-9295-471d-9c96-5c685de46943 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lazy-loading 'services' on Instance uuid 685030b8-7128-4366-a241-55617cbe5b1f {{(pid=118994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:10:50.745320 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-7d463ee8-9295-471d-9c96-5c685de46943 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "DELETE /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f/os-volume_attachments/cf869940-d7ef-499c-959c-615a0f887458" status: 202 len: 0 microversion: 2.1 time: 0.175977 Oct 11 12:10:50.746097 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 416/876] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Oct 11 12:10:50 2022] DELETE /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f/os-volume_attachments/cf869940-d7ef-499c-959c-615a0f887458 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 12:10:51.442496 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5be23ab3-f0ff-439f-8ee7-5ad78c36c4c4 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:51.443172 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-5be23ab3-f0ff-439f-8ee7-5ad78c36c4c4 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:51.449706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5be23ab3-f0ff-439f-8ee7-5ad78c36c4c4 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:51.450187 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5be23ab3-f0ff-439f-8ee7-5ad78c36c4c4 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:51.450643 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5be23ab3-f0ff-439f-8ee7-5ad78c36c4c4 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:51.451338 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5be23ab3-f0ff-439f-8ee7-5ad78c36c4c4 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:51.451786 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5be23ab3-f0ff-439f-8ee7-5ad78c36c4c4 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:51.452203 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5be23ab3-f0ff-439f-8ee7-5ad78c36c4c4 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:51.587429 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5be23ab3-f0ff-439f-8ee7-5ad78c36c4c4 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:51.595442 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5be23ab3-f0ff-439f-8ee7-5ad78c36c4c4 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1575 microversion: 2.1 time: 0.156838 Oct 11 12:10:51.596010 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 461/877] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:51 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:52.619526 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-1c653f5e-41fb-44fc-929a-ecaebbd7c29c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:52.620643 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-1c653f5e-41fb-44fc-929a-ecaebbd7c29c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:52.627357 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1c653f5e-41fb-44fc-929a-ecaebbd7c29c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:52.627833 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1c653f5e-41fb-44fc-929a-ecaebbd7c29c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:52.628261 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1c653f5e-41fb-44fc-929a-ecaebbd7c29c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:52.628946 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1c653f5e-41fb-44fc-929a-ecaebbd7c29c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:52.629550 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1c653f5e-41fb-44fc-929a-ecaebbd7c29c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:52.630183 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1c653f5e-41fb-44fc-929a-ecaebbd7c29c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:52.768493 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-1c653f5e-41fb-44fc-929a-ecaebbd7c29c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:52.777380 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-1c653f5e-41fb-44fc-929a-ecaebbd7c29c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1575 microversion: 2.1 time: 0.162880 Oct 11 12:10:52.777973 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 417/878] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:52 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:52.948662 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-868ac915-7301-485e-ab59-815ba6dec7b9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:52.949150 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-868ac915-7301-485e-ab59-815ba6dec7b9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: 685030b8-7128-4366-a241-55617cbe5b1f] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:52.956344 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-868ac915-7301-485e-ab59-815ba6dec7b9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:52.956816 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-868ac915-7301-485e-ab59-815ba6dec7b9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:52.957317 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-868ac915-7301-485e-ab59-815ba6dec7b9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:52.958012 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-868ac915-7301-485e-ab59-815ba6dec7b9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:52.958734 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-868ac915-7301-485e-ab59-815ba6dec7b9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:52.959157 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-868ac915-7301-485e-ab59-815ba6dec7b9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:52.991050 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-868ac915-7301-485e-ab59-815ba6dec7b9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f/os-volume_attachments/bcab2c9e-9f70-4341-9c6f-119a04d62599" status: 200 len: 194 microversion: 2.1 time: 0.046325 Oct 11 12:10:52.991652 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 462/879] 10.222.0.59 () {58 vars in 1413 bytes} [Tue Oct 11 12:10:52 2022] GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f/os-volume_attachments/bcab2c9e-9f70-4341-9c6f-119a04d62599 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:10:53.003018 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-658d592a-00ae-41c2-873d-45765635c721 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:53.003532 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-658d592a-00ae-41c2-873d-45765635c721 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: 685030b8-7128-4366-a241-55617cbe5b1f] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:53.009743 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-658d592a-00ae-41c2-873d-45765635c721 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:53.010222 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-658d592a-00ae-41c2-873d-45765635c721 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:53.010668 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-658d592a-00ae-41c2-873d-45765635c721 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:53.011357 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-658d592a-00ae-41c2-873d-45765635c721 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:53.011978 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-658d592a-00ae-41c2-873d-45765635c721 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:53.012436 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-658d592a-00ae-41c2-873d-45765635c721 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:53.096344 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.objects.instance [None req-658d592a-00ae-41c2-873d-45765635c721 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lazy-loading 'services' on Instance uuid 685030b8-7128-4366-a241-55617cbe5b1f {{(pid=118994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:10:53.172090 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-658d592a-00ae-41c2-873d-45765635c721 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "DELETE /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f/os-volume_attachments/bcab2c9e-9f70-4341-9c6f-119a04d62599" status: 202 len: 0 microversion: 2.1 time: 0.173409 Oct 11 12:10:53.172941 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 418/880] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Oct 11 12:10:52 2022] DELETE /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f/os-volume_attachments/bcab2c9e-9f70-4341-9c6f-119a04d62599 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 12:10:53.801252 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c97e1666-74c4-435f-9042-2657713c6b99 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:53.802039 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c97e1666-74c4-435f-9042-2657713c6b99 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:53.808604 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c97e1666-74c4-435f-9042-2657713c6b99 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:53.809172 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c97e1666-74c4-435f-9042-2657713c6b99 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:53.809683 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c97e1666-74c4-435f-9042-2657713c6b99 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:53.810456 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c97e1666-74c4-435f-9042-2657713c6b99 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:53.811022 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c97e1666-74c4-435f-9042-2657713c6b99 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:53.811515 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c97e1666-74c4-435f-9042-2657713c6b99 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:53.984305 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c97e1666-74c4-435f-9042-2657713c6b99 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:53.993045 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c97e1666-74c4-435f-9042-2657713c6b99 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1575 microversion: 2.1 time: 0.195641 Oct 11 12:10:53.994292 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 463/881] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:53 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1575 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:55.019291 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-1339e1aa-b515-4d98-92f8-40304116be59 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:55.020216 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-1339e1aa-b515-4d98-92f8-40304116be59 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:55.022396 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:10:55.028424 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1339e1aa-b515-4d98-92f8-40304116be59 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:55.028928 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1339e1aa-b515-4d98-92f8-40304116be59 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:55.029356 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1339e1aa-b515-4d98-92f8-40304116be59 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:55.030042 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1339e1aa-b515-4d98-92f8-40304116be59 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:55.030489 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1339e1aa-b515-4d98-92f8-40304116be59 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:55.030938 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1339e1aa-b515-4d98-92f8-40304116be59 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:55.174735 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-1339e1aa-b515-4d98-92f8-40304116be59 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:55.182736 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-1339e1aa-b515-4d98-92f8-40304116be59 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1575 microversion: 2.1 time: 0.170209 Oct 11 12:10:55.183273 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 419/882] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:55 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:55.424143 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f9ad21b2-e8ea-42b2-8ec1-6dc61de6998c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:55.426286 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f9ad21b2-e8ea-42b2-8ec1-6dc61de6998c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: 685030b8-7128-4366-a241-55617cbe5b1f] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:55.432784 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f9ad21b2-e8ea-42b2-8ec1-6dc61de6998c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:55.433257 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f9ad21b2-e8ea-42b2-8ec1-6dc61de6998c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:55.433690 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f9ad21b2-e8ea-42b2-8ec1-6dc61de6998c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:55.434386 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f9ad21b2-e8ea-42b2-8ec1-6dc61de6998c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:55.434861 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f9ad21b2-e8ea-42b2-8ec1-6dc61de6998c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:55.435294 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f9ad21b2-e8ea-42b2-8ec1-6dc61de6998c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:55.464708 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f9ad21b2-e8ea-42b2-8ec1-6dc61de6998c tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044449 Oct 11 12:10:55.465276 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 464/883] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Oct 11 12:10:55 2022] GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 12:10:55.583335 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-9839197c-7d00-4399-a85b-3570aa9efde7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:55.585997 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-9839197c-7d00-4399-a85b-3570aa9efde7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: 685030b8-7128-4366-a241-55617cbe5b1f] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:55.591965 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9839197c-7d00-4399-a85b-3570aa9efde7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:55.592461 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9839197c-7d00-4399-a85b-3570aa9efde7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:55.592866 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9839197c-7d00-4399-a85b-3570aa9efde7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:55.593571 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9839197c-7d00-4399-a85b-3570aa9efde7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:55.594009 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9839197c-7d00-4399-a85b-3570aa9efde7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:55.594418 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9839197c-7d00-4399-a85b-3570aa9efde7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:55.622998 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-9839197c-7d00-4399-a85b-3570aa9efde7 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043690 Oct 11 12:10:55.623637 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 420/884] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Oct 11 12:10:55 2022] GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 12:10:55.695578 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b8074691-2c3b-4eb5-95d3-9f42fd974207 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:55.696158 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-b8074691-2c3b-4eb5-95d3-9f42fd974207 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: 685030b8-7128-4366-a241-55617cbe5b1f] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:55.702234 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b8074691-2c3b-4eb5-95d3-9f42fd974207 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:55.702824 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b8074691-2c3b-4eb5-95d3-9f42fd974207 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:55.703326 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b8074691-2c3b-4eb5-95d3-9f42fd974207 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:55.704174 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b8074691-2c3b-4eb5-95d3-9f42fd974207 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:55.704594 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b8074691-2c3b-4eb5-95d3-9f42fd974207 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:55.705079 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b8074691-2c3b-4eb5-95d3-9f42fd974207 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:55.732674 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-b8074691-2c3b-4eb5-95d3-9f42fd974207 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: 685030b8-7128-4366-a241-55617cbe5b1f] Going to try to terminate instance {{(pid=118995) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 12:10:55.816927 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b8074691-2c3b-4eb5-95d3-9f42fd974207 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "DELETE /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f" status: 204 len: 0 microversion: 2.1 time: 0.124987 Oct 11 12:10:55.817803 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 465/885] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Oct 11 12:10:55 2022] DELETE /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 12:10:55.827948 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-3666f739-8431-49ed-95a4-07a723a3d7bc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:55.828696 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-3666f739-8431-49ed-95a4-07a723a3d7bc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: 685030b8-7128-4366-a241-55617cbe5b1f] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:55.835213 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3666f739-8431-49ed-95a4-07a723a3d7bc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:55.835793 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3666f739-8431-49ed-95a4-07a723a3d7bc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:55.836294 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3666f739-8431-49ed-95a4-07a723a3d7bc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:55.837061 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3666f739-8431-49ed-95a4-07a723a3d7bc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:55.837577 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3666f739-8431-49ed-95a4-07a723a3d7bc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:55.838162 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3666f739-8431-49ed-95a4-07a723a3d7bc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:55.978669 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-3666f739-8431-49ed-95a4-07a723a3d7bc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:55.987036 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-3666f739-8431-49ed-95a4-07a723a3d7bc tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f" status: 200 len: 1672 microversion: 2.1 time: 0.162923 Oct 11 12:10:55.987633 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 421/886] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:55 2022] GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f => generated 1672 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:56.210637 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c07f5246-d775-4f49-afbd-b35e76f53ae6 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:56.211402 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c07f5246-d775-4f49-afbd-b35e76f53ae6 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:56.220514 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c07f5246-d775-4f49-afbd-b35e76f53ae6 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:56.221185 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c07f5246-d775-4f49-afbd-b35e76f53ae6 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:56.221775 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c07f5246-d775-4f49-afbd-b35e76f53ae6 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:56.222514 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c07f5246-d775-4f49-afbd-b35e76f53ae6 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:56.223205 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c07f5246-d775-4f49-afbd-b35e76f53ae6 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:56.223801 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c07f5246-d775-4f49-afbd-b35e76f53ae6 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:56.380688 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c07f5246-d775-4f49-afbd-b35e76f53ae6 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:56.388793 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c07f5246-d775-4f49-afbd-b35e76f53ae6 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1575 microversion: 2.1 time: 0.184841 Oct 11 12:10:56.389202 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 466/887] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:56 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1575 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:57.011660 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-f57ed183-942b-4c00-b82d-7b76266c47c9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:57.012395 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-f57ed183-942b-4c00-b82d-7b76266c47c9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: 685030b8-7128-4366-a241-55617cbe5b1f] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:57.019396 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f57ed183-942b-4c00-b82d-7b76266c47c9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:57.019920 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f57ed183-942b-4c00-b82d-7b76266c47c9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:57.020356 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f57ed183-942b-4c00-b82d-7b76266c47c9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:57.021164 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f57ed183-942b-4c00-b82d-7b76266c47c9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:57.021614 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f57ed183-942b-4c00-b82d-7b76266c47c9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:57.022029 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f57ed183-942b-4c00-b82d-7b76266c47c9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:57.163590 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-f57ed183-942b-4c00-b82d-7b76266c47c9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:57.168040 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-f57ed183-942b-4c00-b82d-7b76266c47c9 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f" status: 200 len: 1672 microversion: 2.1 time: 0.160641 Oct 11 12:10:57.168616 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 422/888] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:57 2022] GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:57.418711 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-785a3785-08aa-4d72-a45c-751fdaf17556 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:57.419287 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-785a3785-08aa-4d72-a45c-751fdaf17556 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:57.426443 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-785a3785-08aa-4d72-a45c-751fdaf17556 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:57.426994 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-785a3785-08aa-4d72-a45c-751fdaf17556 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:57.427556 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-785a3785-08aa-4d72-a45c-751fdaf17556 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:57.428248 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-785a3785-08aa-4d72-a45c-751fdaf17556 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:57.428707 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-785a3785-08aa-4d72-a45c-751fdaf17556 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:57.429131 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-785a3785-08aa-4d72-a45c-751fdaf17556 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:57.578718 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-785a3785-08aa-4d72-a45c-751fdaf17556 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:57.588727 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-785a3785-08aa-4d72-a45c-751fdaf17556 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1575 microversion: 2.1 time: 0.174096 Oct 11 12:10:57.589292 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 467/889] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:57 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:58.193055 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-52756d4f-6741-4e94-8dce-51cc2ad5f1f6 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:58.193675 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-52756d4f-6741-4e94-8dce-51cc2ad5f1f6 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: 685030b8-7128-4366-a241-55617cbe5b1f] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:58.200868 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-52756d4f-6741-4e94-8dce-51cc2ad5f1f6 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:58.201357 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-52756d4f-6741-4e94-8dce-51cc2ad5f1f6 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:58.201790 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-52756d4f-6741-4e94-8dce-51cc2ad5f1f6 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:58.202497 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-52756d4f-6741-4e94-8dce-51cc2ad5f1f6 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:58.202984 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-52756d4f-6741-4e94-8dce-51cc2ad5f1f6 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:58.203403 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-52756d4f-6741-4e94-8dce-51cc2ad5f1f6 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:58.371537 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-52756d4f-6741-4e94-8dce-51cc2ad5f1f6 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:58.380451 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-52756d4f-6741-4e94-8dce-51cc2ad5f1f6 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f" status: 200 len: 1672 microversion: 2.1 time: 0.192020 Oct 11 12:10:58.381142 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 423/890] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:58 2022] GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f => generated 1672 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:58.612079 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-77d8afc7-c836-45d7-aa6b-a62c92609018 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:58.612685 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-77d8afc7-c836-45d7-aa6b-a62c92609018 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:58.621380 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-77d8afc7-c836-45d7-aa6b-a62c92609018 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:58.622086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-77d8afc7-c836-45d7-aa6b-a62c92609018 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:58.622954 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-77d8afc7-c836-45d7-aa6b-a62c92609018 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:58.624070 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-77d8afc7-c836-45d7-aa6b-a62c92609018 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:58.624936 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-77d8afc7-c836-45d7-aa6b-a62c92609018 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:58.625560 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-77d8afc7-c836-45d7-aa6b-a62c92609018 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:58.834181 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-77d8afc7-c836-45d7-aa6b-a62c92609018 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:58.842211 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-77d8afc7-c836-45d7-aa6b-a62c92609018 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1575 microversion: 2.1 time: 0.234230 Oct 11 12:10:58.842815 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 468/891] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:58 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1575 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:59.351227 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-095d4406-a123-44f5-8a5e-353a39772029 req-d671f7f8-679f-45ba-b5fe-9e873b3af472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "685030b8-7128-4366-a241-55617cbe5b1f", "name": "network-vif-deleted", "tag": "46ec508e-a8e6-4d19-a304-ae2d3a333e4e"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:10:59.361690 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-095d4406-a123-44f5-8a5e-353a39772029 req-d671f7f8-679f-45ba-b5fe-9e873b3af472 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:59.362170 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-095d4406-a123-44f5-8a5e-353a39772029 req-d671f7f8-679f-45ba-b5fe-9e873b3af472 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:59.362653 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-095d4406-a123-44f5-8a5e-353a39772029 req-d671f7f8-679f-45ba-b5fe-9e873b3af472 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:59.375643 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-095d4406-a123-44f5-8a5e-353a39772029 req-d671f7f8-679f-45ba-b5fe-9e873b3af472 service nova] Creating event network-vif-deleted:46ec508e-a8e6-4d19-a304-ae2d3a333e4e for instance 685030b8-7128-4366-a241-55617cbe5b1f on hv-cinder-82099 Oct 11 12:10:59.380930 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-095d4406-a123-44f5-8a5e-353a39772029 req-d671f7f8-679f-45ba-b5fe-9e873b3af472 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168778 Oct 11 12:10:59.384966 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 424/892] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:10:59.406155 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-3d19a235-2b23-44ba-bc96-64ac4c0b46aa tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:59.406889 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-3d19a235-2b23-44ba-bc96-64ac4c0b46aa tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: 685030b8-7128-4366-a241-55617cbe5b1f] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:59.414435 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3d19a235-2b23-44ba-bc96-64ac4c0b46aa tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:59.415345 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3d19a235-2b23-44ba-bc96-64ac4c0b46aa tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:59.415783 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3d19a235-2b23-44ba-bc96-64ac4c0b46aa tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:59.416527 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3d19a235-2b23-44ba-bc96-64ac4c0b46aa tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:59.416982 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3d19a235-2b23-44ba-bc96-64ac4c0b46aa tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:59.417403 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-3d19a235-2b23-44ba-bc96-64ac4c0b46aa tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:59.479837 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-3d19a235-2b23-44ba-bc96-64ac4c0b46aa tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a78e40d4eb554ca49eeec530a7adf428', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a7beb3a9d2b4ee9ba323d5bccc618c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:10:59.488407 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-3d19a235-2b23-44ba-bc96-64ac4c0b46aa tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f" status: 200 len: 1605 microversion: 2.1 time: 0.087759 Oct 11 12:10:59.489074 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 469/893] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:59 2022] GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f => generated 1605 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:10:59.869181 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-a9127b4b-7b89-45cb-a2b5-2e60ffa3c80a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:10:59.870156 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-a9127b4b-7b89-45cb-a2b5-2e60ffa3c80a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:10:59.878956 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a9127b4b-7b89-45cb-a2b5-2e60ffa3c80a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:59.879699 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a9127b4b-7b89-45cb-a2b5-2e60ffa3c80a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:59.880366 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a9127b4b-7b89-45cb-a2b5-2e60ffa3c80a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:10:59.881336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a9127b4b-7b89-45cb-a2b5-2e60ffa3c80a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:10:59.881791 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a9127b4b-7b89-45cb-a2b5-2e60ffa3c80a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:10:59.882514 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a9127b4b-7b89-45cb-a2b5-2e60ffa3c80a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:00.046927 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-a9127b4b-7b89-45cb-a2b5-2e60ffa3c80a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:11:00.051543 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:11:00.058082 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-a9127b4b-7b89-45cb-a2b5-2e60ffa3c80a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1575 microversion: 2.1 time: 0.195212 Oct 11 12:11:00.059134 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 425/894] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:10:59 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1575 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:11:00.512382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-31ef45e3-4c75-4e45-a729-ca9d9dcc2518 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:00.513482 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-31ef45e3-4c75-4e45-a729-ca9d9dcc2518 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: 685030b8-7128-4366-a241-55617cbe5b1f] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:00.519757 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=2 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:11:00.522132 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-31ef45e3-4c75-4e45-a729-ca9d9dcc2518 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:00.523132 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-31ef45e3-4c75-4e45-a729-ca9d9dcc2518 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:00.523724 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-31ef45e3-4c75-4e45-a729-ca9d9dcc2518 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:00.524567 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-31ef45e3-4c75-4e45-a729-ca9d9dcc2518 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:00.525118 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-31ef45e3-4c75-4e45-a729-ca9d9dcc2518 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:00.525638 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-31ef45e3-4c75-4e45-a729-ca9d9dcc2518 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:00.544786 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-31ef45e3-4c75-4e45-a729-ca9d9dcc2518 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] HTTP exception thrown: Instance 685030b8-7128-4366-a241-55617cbe5b1f could not be found. Oct 11 12:11:00.546648 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-31ef45e3-4c75-4e45-a729-ca9d9dcc2518 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Request method failure captured: Oct 11 12:11:00.546648 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f HTTP/1.1 Oct 11 12:11:00.546648 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 11 12:11:00.546648 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 11 12:11:00.546648 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Connection: close Oct 11 12:11:00.546648 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 11 12:11:00.546648 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 11 12:11:00.546648 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Host: 10.222.0.59 Oct 11 12:11:00.546648 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 11 12:11:00.546648 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 11 12:11:00.546648 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjRVs9QtNHBzSTX4aaGIn1kjA3g8hCveim2qiQItdwRP8ypMDo8vouc4V172UwiJwCvsASOxUr3GqC_0b097Blcy0Id7ENCk6xsYTLbUSoUKy0bmF_QHk7OkvwiTjtN93jNN2lvdXFSEWe6-0SgSs_4_52JIjrHwCFI_UNfqPxe1BXzqg Oct 11 12:11:00.546648 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 11 12:11:00.546648 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 11 12:11:00.546648 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 11 12:11:00.546648 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 11 12:11:00.546648 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 11 12:11:00.546648 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 11 12:11:00.546648 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Id: 9a7beb3a9d2b4ee9ba323d5bccc618c2 Oct 11 12:11:00.546648 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-AttachVolumeTestJSON-2100711064 Oct 11 12:11:00.546648 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Role: reader,member Oct 11 12:11:00.546648 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Roles: reader,member Oct 11 12:11:00.548459 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9a7beb3a9d2b4ee9ba323d5bccc618c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9a7beb3a9d2b4ee9ba323d5bccc618c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a7beb3a9d2b4ee9ba323d5bccc618c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a7beb3a9d2b4ee9ba323d5bccc618c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:11:00.548459 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-AttachVolumeTestJSON-2100711064 Oct 11 12:11:00.548459 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 9a7beb3a9d2b4ee9ba323d5bccc618c2 Oct 11 12:11:00.548459 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2100711064 Oct 11 12:11:00.548459 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User: tempest-AttachVolumeTestJSON-2100711064-project Oct 11 12:11:00.548459 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 11 12:11:00.548459 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 11 12:11:00.548459 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Id: a78e40d4eb554ca49eeec530a7adf428 Oct 11 12:11:00.548459 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-AttachVolumeTestJSON-2100711064-project Oct 11 12:11:00.548459 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: method: > Oct 11 12:11:00.548459 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: exception: Instance 685030b8-7128-4366-a241-55617cbe5b1f could not be found. Oct 11 12:11:00.548459 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: action_args: {'id': '685030b8-7128-4366-a241-55617cbe5b1f'} Oct 11 12:11:00.550803 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:11:00.550803 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:11:00.550803 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:11:00.550803 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:11:00.550803 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:11:00.550803 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:11:00.550803 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:11:00.550803 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:11:00.550803 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:11:00.550803 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:11:00.550803 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 685030b8-7128-4366-a241-55617cbe5b1f could not be found. Oct 11 12:11:00.550803 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:11:00.550803 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:11:00.550803 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:11:00.550803 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:11:00.550803 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:11:00.550803 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:11:00.550803 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:11:00.550803 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:11:00.550803 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:11:00.552460 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:11:00.552460 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 12:11:00.552460 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 12:11:00.552460 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:11:00.552460 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:11:00.552460 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:11:00.552460 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:11:00.552460 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 685030b8-7128-4366-a241-55617cbe5b1f could not be found. Oct 11 12:11:00.552460 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:11:00.552460 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:11:00.552460 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:11:00.552460 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:11:00.552460 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:11:00.552460 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:11:00.552460 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:11:00.552460 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:11:00.552460 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 685030b8-7128-4366-a241-55617cbe5b1f could not be found. Oct 11 12:11:00.552460 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:11:00.553725 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-31ef45e3-4c75-4e45-a729-ca9d9dcc2518 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Returning 404 to user: Instance 685030b8-7128-4366-a241-55617cbe5b1f could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:11:00.553725 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-31ef45e3-4c75-4e45-a729-ca9d9dcc2518 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f" status: 404 len: 111 microversion: 2.1 time: 0.040284 Oct 11 12:11:00.553725 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 470/895] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:11:00 2022] GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:11:00.558339 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-4f76c426-ced3-429a-9871-965ee9285140 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '.version_select at 0x7fd4065dd310>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:00.579825 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-4f76c426-ced3-429a-9871-965ee9285140 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1796809927" status: 202 len: 0 microversion: 2.1 time: 0.025736 Oct 11 12:11:00.580416 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 426/896] 10.222.0.59 () {58 vars in 1221 bytes} [Tue Oct 11 12:11:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1796809927 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 12:11:01.082718 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d647d489-e4a0-4798-822c-4475a13d3426 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:01.083336 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d647d489-e4a0-4798-822c-4475a13d3426 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:01.090257 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d647d489-e4a0-4798-822c-4475a13d3426 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:01.090818 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d647d489-e4a0-4798-822c-4475a13d3426 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:01.091202 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d647d489-e4a0-4798-822c-4475a13d3426 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:01.092378 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d647d489-e4a0-4798-822c-4475a13d3426 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:01.092947 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d647d489-e4a0-4798-822c-4475a13d3426 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:01.093333 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d647d489-e4a0-4798-822c-4475a13d3426 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:01.255222 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d647d489-e4a0-4798-822c-4475a13d3426 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:11:01.268292 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d647d489-e4a0-4798-822c-4475a13d3426 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1575 microversion: 2.1 time: 0.188860 Oct 11 12:11:01.269418 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 471/897] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:11:01 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1575 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:11:02.294729 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-6b76031d-b6b9-4db2-913a-7970067af9dd tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:02.295515 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-6b76031d-b6b9-4db2-913a-7970067af9dd tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:02.304993 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6b76031d-b6b9-4db2-913a-7970067af9dd tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:02.305661 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6b76031d-b6b9-4db2-913a-7970067af9dd tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:02.306333 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6b76031d-b6b9-4db2-913a-7970067af9dd tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:02.307506 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6b76031d-b6b9-4db2-913a-7970067af9dd tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:02.308221 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6b76031d-b6b9-4db2-913a-7970067af9dd tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:02.308921 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6b76031d-b6b9-4db2-913a-7970067af9dd tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:02.457378 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-6b76031d-b6b9-4db2-913a-7970067af9dd tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:11:02.465452 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-6b76031d-b6b9-4db2-913a-7970067af9dd tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1575 microversion: 2.1 time: 0.175234 Oct 11 12:11:02.466039 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 427/898] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:11:02 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1575 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:11:02.643122 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-a33c6125-6def-4f30-bd8f-25506274de07 req-a9852bb2-7b56-452a-bd10-c6c1f9dbaf8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ddb150d-886c-46f4-9c3d-0722148d7d91", "name": "network-vif-plugged", "status": "completed", "tag": "473109ef-4d1a-4e60-84ad-152e53b93a74"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:11:02.654910 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-a33c6125-6def-4f30-bd8f-25506274de07 req-a9852bb2-7b56-452a-bd10-c6c1f9dbaf8e service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:02.655379 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-a33c6125-6def-4f30-bd8f-25506274de07 req-a9852bb2-7b56-452a-bd10-c6c1f9dbaf8e service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:02.656105 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-a33c6125-6def-4f30-bd8f-25506274de07 req-a9852bb2-7b56-452a-bd10-c6c1f9dbaf8e service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:02.669034 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-a33c6125-6def-4f30-bd8f-25506274de07 req-a9852bb2-7b56-452a-bd10-c6c1f9dbaf8e service nova] Creating event network-vif-plugged:473109ef-4d1a-4e60-84ad-152e53b93a74 for instance 5ddb150d-886c-46f4-9c3d-0722148d7d91 on hv-cinder-82099 Oct 11 12:11:02.674207 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-a33c6125-6def-4f30-bd8f-25506274de07 req-a9852bb2-7b56-452a-bd10-c6c1f9dbaf8e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035113 Oct 11 12:11:02.675056 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 472/899] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:11:03.489930 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-717d664a-46b8-4152-beb9-354c2cd8147c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:03.490542 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-717d664a-46b8-4152-beb9-354c2cd8147c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:03.497306 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-717d664a-46b8-4152-beb9-354c2cd8147c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:03.497800 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-717d664a-46b8-4152-beb9-354c2cd8147c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:03.498237 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-717d664a-46b8-4152-beb9-354c2cd8147c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:03.498945 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-717d664a-46b8-4152-beb9-354c2cd8147c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:03.499374 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-717d664a-46b8-4152-beb9-354c2cd8147c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:03.499790 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-717d664a-46b8-4152-beb9-354c2cd8147c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:03.579333 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b97bd225-6bb5-4c08-9de3-2f2e4d5600b1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:03.579904 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-b97bd225-6bb5-4c08-9de3-2f2e4d5600b1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: 685030b8-7128-4366-a241-55617cbe5b1f] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:03.586868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b97bd225-6bb5-4c08-9de3-2f2e4d5600b1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:03.587356 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b97bd225-6bb5-4c08-9de3-2f2e4d5600b1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:03.587786 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b97bd225-6bb5-4c08-9de3-2f2e4d5600b1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:03.588486 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b97bd225-6bb5-4c08-9de3-2f2e4d5600b1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:03.588991 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b97bd225-6bb5-4c08-9de3-2f2e4d5600b1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:03.589355 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b97bd225-6bb5-4c08-9de3-2f2e4d5600b1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:03.603329 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-b97bd225-6bb5-4c08-9de3-2f2e4d5600b1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] HTTP exception thrown: Instance 685030b8-7128-4366-a241-55617cbe5b1f could not be found. Oct 11 12:11:03.605063 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b97bd225-6bb5-4c08-9de3-2f2e4d5600b1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Request method failure captured: Oct 11 12:11:03.605063 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: request: DELETE /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f HTTP/1.1 Oct 11 12:11:03.605063 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 11 12:11:03.605063 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 11 12:11:03.605063 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Connection: close Oct 11 12:11:03.605063 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 11 12:11:03.605063 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 11 12:11:03.605063 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Host: 10.222.0.59 Oct 11 12:11:03.605063 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 11 12:11:03.605063 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 11 12:11:03.605063 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjRVs9QtNHBzSTX4aaGIn1kjA3g8hCveim2qiQItdwRP8ypMDo8vouc4V172UwiJwCvsASOxUr3GqC_0b097Blcy0Id7ENCk6xsYTLbUSoUKy0bmF_QHk7OkvwiTjtN93jNN2lvdXFSEWe6-0SgSs_4_52JIjrHwCFI_UNfqPxe1BXzqg Oct 11 12:11:03.605063 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 11 12:11:03.605063 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 11 12:11:03.605063 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 11 12:11:03.605063 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 11 12:11:03.605063 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 11 12:11:03.605063 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 11 12:11:03.605063 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Id: 9a7beb3a9d2b4ee9ba323d5bccc618c2 Oct 11 12:11:03.605063 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-AttachVolumeTestJSON-2100711064 Oct 11 12:11:03.605063 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Role: reader,member Oct 11 12:11:03.605063 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Roles: reader,member Oct 11 12:11:03.606728 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9a7beb3a9d2b4ee9ba323d5bccc618c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9a7beb3a9d2b4ee9ba323d5bccc618c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a7beb3a9d2b4ee9ba323d5bccc618c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a7beb3a9d2b4ee9ba323d5bccc618c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:11:03.606728 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-AttachVolumeTestJSON-2100711064 Oct 11 12:11:03.606728 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 9a7beb3a9d2b4ee9ba323d5bccc618c2 Oct 11 12:11:03.606728 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2100711064 Oct 11 12:11:03.606728 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User: tempest-AttachVolumeTestJSON-2100711064-project Oct 11 12:11:03.606728 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 11 12:11:03.606728 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 11 12:11:03.606728 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Id: a78e40d4eb554ca49eeec530a7adf428 Oct 11 12:11:03.606728 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-AttachVolumeTestJSON-2100711064-project Oct 11 12:11:03.606728 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: method: > Oct 11 12:11:03.606728 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: exception: Instance 685030b8-7128-4366-a241-55617cbe5b1f could not be found. Oct 11 12:11:03.606728 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: action_args: {'id': '685030b8-7128-4366-a241-55617cbe5b1f'} Oct 11 12:11:03.607631 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:11:03.607631 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:11:03.607631 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:11:03.607631 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:11:03.607631 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:11:03.607631 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:11:03.607631 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:11:03.607631 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:11:03.607631 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:11:03.607631 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:11:03.607631 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 685030b8-7128-4366-a241-55617cbe5b1f could not be found. Oct 11 12:11:03.607631 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:11:03.607631 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:11:03.607631 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:11:03.607631 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:11:03.607631 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:11:03.607631 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:11:03.607631 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:11:03.607631 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:11:03.607631 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:11:03.609092 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:11:03.609092 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 12:11:03.609092 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 12:11:03.609092 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 12:11:03.609092 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 12:11:03.609092 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:11:03.609092 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:11:03.609092 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:11:03.609092 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:11:03.609092 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 685030b8-7128-4366-a241-55617cbe5b1f could not be found. Oct 11 12:11:03.609092 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:11:03.609092 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:11:03.609092 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:11:03.609092 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:11:03.609092 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:11:03.609092 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:11:03.609092 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:11:03.609092 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:11:03.609092 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 685030b8-7128-4366-a241-55617cbe5b1f could not be found. Oct 11 12:11:03.609092 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:11:03.610628 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b97bd225-6bb5-4c08-9de3-2f2e4d5600b1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Returning 404 to user: Instance 685030b8-7128-4366-a241-55617cbe5b1f could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:11:03.610628 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b97bd225-6bb5-4c08-9de3-2f2e4d5600b1 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "DELETE /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f" status: 404 len: 111 microversion: 2.1 time: 0.031555 Oct 11 12:11:03.610628 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 473/900] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Oct 11 12:11:03 2022] DELETE /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:11:03.615037 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e765b762-2084-4e2f-9f08-85bf446f2c15 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:03.615650 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e765b762-2084-4e2f-9f08-85bf446f2c15 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: 685030b8-7128-4366-a241-55617cbe5b1f] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:03.621509 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e765b762-2084-4e2f-9f08-85bf446f2c15 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:03.621986 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e765b762-2084-4e2f-9f08-85bf446f2c15 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:03.622416 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e765b762-2084-4e2f-9f08-85bf446f2c15 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:03.623133 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e765b762-2084-4e2f-9f08-85bf446f2c15 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:03.623581 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e765b762-2084-4e2f-9f08-85bf446f2c15 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:03.623999 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e765b762-2084-4e2f-9f08-85bf446f2c15 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:03.637457 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-e765b762-2084-4e2f-9f08-85bf446f2c15 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] HTTP exception thrown: Instance 685030b8-7128-4366-a241-55617cbe5b1f could not be found. Oct 11 12:11:03.639049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e765b762-2084-4e2f-9f08-85bf446f2c15 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Request method failure captured: Oct 11 12:11:03.639049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f HTTP/1.1 Oct 11 12:11:03.639049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 11 12:11:03.639049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 11 12:11:03.639049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Connection: close Oct 11 12:11:03.639049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 11 12:11:03.639049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 11 12:11:03.639049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Host: 10.222.0.59 Oct 11 12:11:03.639049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 11 12:11:03.639049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 11 12:11:03.639049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjRVs9QtNHBzSTX4aaGIn1kjA3g8hCveim2qiQItdwRP8ypMDo8vouc4V172UwiJwCvsASOxUr3GqC_0b097Blcy0Id7ENCk6xsYTLbUSoUKy0bmF_QHk7OkvwiTjtN93jNN2lvdXFSEWe6-0SgSs_4_52JIjrHwCFI_UNfqPxe1BXzqg Oct 11 12:11:03.639049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 11 12:11:03.639049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 11 12:11:03.639049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 11 12:11:03.639049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 11 12:11:03.639049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 11 12:11:03.639049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 11 12:11:03.639049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Id: 9a7beb3a9d2b4ee9ba323d5bccc618c2 Oct 11 12:11:03.639049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-AttachVolumeTestJSON-2100711064 Oct 11 12:11:03.639049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Role: reader,member Oct 11 12:11:03.639049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Roles: reader,member Oct 11 12:11:03.640908 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9a7beb3a9d2b4ee9ba323d5bccc618c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9a7beb3a9d2b4ee9ba323d5bccc618c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a7beb3a9d2b4ee9ba323d5bccc618c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a7beb3a9d2b4ee9ba323d5bccc618c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:11:03.640908 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-AttachVolumeTestJSON-2100711064 Oct 11 12:11:03.640908 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 9a7beb3a9d2b4ee9ba323d5bccc618c2 Oct 11 12:11:03.640908 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2100711064 Oct 11 12:11:03.640908 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User: tempest-AttachVolumeTestJSON-2100711064-project Oct 11 12:11:03.640908 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 11 12:11:03.640908 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 11 12:11:03.640908 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Id: a78e40d4eb554ca49eeec530a7adf428 Oct 11 12:11:03.640908 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-AttachVolumeTestJSON-2100711064-project Oct 11 12:11:03.640908 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: method: > Oct 11 12:11:03.640908 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: exception: Instance 685030b8-7128-4366-a241-55617cbe5b1f could not be found. Oct 11 12:11:03.640908 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: action_args: {'id': '685030b8-7128-4366-a241-55617cbe5b1f'} Oct 11 12:11:03.642218 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:11:03.642218 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:11:03.642218 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:11:03.642218 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:11:03.642218 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:11:03.642218 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:11:03.642218 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:11:03.642218 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:11:03.642218 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:11:03.642218 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:11:03.642218 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 685030b8-7128-4366-a241-55617cbe5b1f could not be found. Oct 11 12:11:03.642218 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:11:03.642218 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:11:03.642218 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:11:03.642218 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:11:03.642218 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:11:03.642218 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:11:03.642218 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:11:03.642218 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:11:03.642218 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:11:03.644184 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:11:03.644184 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 12:11:03.644184 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 12:11:03.644184 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:11:03.644184 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:11:03.644184 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:11:03.644184 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:11:03.644184 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 685030b8-7128-4366-a241-55617cbe5b1f could not be found. Oct 11 12:11:03.644184 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:11:03.644184 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:11:03.644184 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:11:03.644184 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:11:03.644184 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:11:03.644184 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:11:03.644184 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:11:03.644184 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:11:03.644184 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 685030b8-7128-4366-a241-55617cbe5b1f could not be found. Oct 11 12:11:03.644184 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:11:03.645434 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e765b762-2084-4e2f-9f08-85bf446f2c15 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Returning 404 to user: Instance 685030b8-7128-4366-a241-55617cbe5b1f could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:11:03.645434 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e765b762-2084-4e2f-9f08-85bf446f2c15 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f" status: 404 len: 111 microversion: 2.1 time: 0.029296 Oct 11 12:11:03.645434 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 474/901] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:11:03 2022] GET /compute/v2.1/servers/685030b8-7128-4366-a241-55617cbe5b1f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:11:03.645682 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-717d664a-46b8-4152-beb9-354c2cd8147c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:11:03.651110 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-717d664a-46b8-4152-beb9-354c2cd8147c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1575 microversion: 2.1 time: 0.165248 Oct 11 12:11:03.651739 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 428/902] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:11:03 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1575 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:11:04.678448 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b0947acd-eb15-4cd2-b12d-1615af71f85a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:04.679349 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-b0947acd-eb15-4cd2-b12d-1615af71f85a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:04.687852 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b0947acd-eb15-4cd2-b12d-1615af71f85a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:04.688521 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b0947acd-eb15-4cd2-b12d-1615af71f85a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:04.688968 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b0947acd-eb15-4cd2-b12d-1615af71f85a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:04.689665 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b0947acd-eb15-4cd2-b12d-1615af71f85a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:04.690116 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b0947acd-eb15-4cd2-b12d-1615af71f85a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:04.690545 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b0947acd-eb15-4cd2-b12d-1615af71f85a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:04.788025 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-39358572-8ecc-4780-b173-a49627ce443d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:04.788556 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-39358572-8ecc-4780-b173-a49627ce443d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:04.795163 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-39358572-8ecc-4780-b173-a49627ce443d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:04.795646 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-39358572-8ecc-4780-b173-a49627ce443d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:04.796068 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-39358572-8ecc-4780-b173-a49627ce443d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:04.796762 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-39358572-8ecc-4780-b173-a49627ce443d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:04.797207 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-39358572-8ecc-4780-b173-a49627ce443d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:04.797624 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-39358572-8ecc-4780-b173-a49627ce443d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:04.811761 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.wsgi [None req-39358572-8ecc-4780-b173-a49627ce443d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] HTTP exception thrown: Instance e3277e26-d502-49fd-ba21-b427effd9d91 could not be found. Oct 11 12:11:04.813460 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-39358572-8ecc-4780-b173-a49627ce443d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Request method failure captured: Oct 11 12:11:04.813460 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: request: DELETE /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 HTTP/1.1 Oct 11 12:11:04.813460 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept: application/json Oct 11 12:11:04.813460 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept-Encoding: identity Oct 11 12:11:04.813460 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Connection: close Oct 11 12:11:04.813460 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Length: 0 Oct 11 12:11:04.813460 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Type: application/json Oct 11 12:11:04.813460 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Host: 10.222.0.59 Oct 11 12:11:04.813460 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Openstack-System-Scope: None Oct 11 12:11:04.813460 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: User-Agent: python-urllib3/1.26.12 Oct 11 12:11:04.813460 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Auth-Token: gAAAAABjRVs9QtNHBzSTX4aaGIn1kjA3g8hCveim2qiQItdwRP8ypMDo8vouc4V172UwiJwCvsASOxUr3GqC_0b097Blcy0Id7ENCk6xsYTLbUSoUKy0bmF_QHk7OkvwiTjtN93jNN2lvdXFSEWe6-0SgSs_4_52JIjrHwCFI_UNfqPxe1BXzqg Oct 11 12:11:04.813460 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Id: None Oct 11 12:11:04.813460 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Name: None Oct 11 12:11:04.813460 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Identity-Status: Confirmed Oct 11 12:11:04.813460 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Is-Admin-Project: True Oct 11 12:11:04.813460 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Id: default Oct 11 12:11:04.813460 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Name: Default Oct 11 12:11:04.813460 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Id: 9a7beb3a9d2b4ee9ba323d5bccc618c2 Oct 11 12:11:04.813460 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Name: tempest-AttachVolumeTestJSON-2100711064 Oct 11 12:11:04.813460 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Role: reader,member Oct 11 12:11:04.813460 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Roles: reader,member Oct 11 12:11:04.814917 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9a7beb3a9d2b4ee9ba323d5bccc618c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9a7beb3a9d2b4ee9ba323d5bccc618c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a7beb3a9d2b4ee9ba323d5bccc618c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a7beb3a9d2b4ee9ba323d5bccc618c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:11:04.814917 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant: tempest-AttachVolumeTestJSON-2100711064 Oct 11 12:11:04.814917 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Id: 9a7beb3a9d2b4ee9ba323d5bccc618c2 Oct 11 12:11:04.814917 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2100711064 Oct 11 12:11:04.814917 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User: tempest-AttachVolumeTestJSON-2100711064-project Oct 11 12:11:04.814917 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Id: default Oct 11 12:11:04.814917 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Name: Default Oct 11 12:11:04.814917 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Id: a78e40d4eb554ca49eeec530a7adf428 Oct 11 12:11:04.814917 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Name: tempest-AttachVolumeTestJSON-2100711064-project Oct 11 12:11:04.814917 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: method: > Oct 11 12:11:04.814917 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: exception: Instance e3277e26-d502-49fd-ba21-b427effd9d91 could not be found. Oct 11 12:11:04.814917 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: action_args: {'id': 'e3277e26-d502-49fd-ba21-b427effd9d91'} Oct 11 12:11:04.815771 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:11:04.815771 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:11:04.815771 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:11:04.815771 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:11:04.815771 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:11:04.815771 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:11:04.815771 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:11:04.815771 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:11:04.815771 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:11:04.815771 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:11:04.815771 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3277e26-d502-49fd-ba21-b427effd9d91 could not be found. Oct 11 12:11:04.815771 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:11:04.815771 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:11:04.815771 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:11:04.815771 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:11:04.815771 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:11:04.815771 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:11:04.815771 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:11:04.815771 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:11:04.815771 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:11:04.816958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:11:04.816958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 12:11:04.816958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 12:11:04.816958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 12:11:04.816958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 12:11:04.816958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:11:04.816958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:11:04.816958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:11:04.816958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:11:04.816958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3277e26-d502-49fd-ba21-b427effd9d91 could not be found. Oct 11 12:11:04.816958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:11:04.816958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:11:04.816958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:11:04.816958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:11:04.816958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:11:04.816958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:11:04.816958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:11:04.816958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:11:04.816958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3277e26-d502-49fd-ba21-b427effd9d91 could not be found. Oct 11 12:11:04.816958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:11:04.818243 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-39358572-8ecc-4780-b173-a49627ce443d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Returning 404 to user: Instance e3277e26-d502-49fd-ba21-b427effd9d91 could not be found. {{(pid=118994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:11:04.818243 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-39358572-8ecc-4780-b173-a49627ce443d tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "DELETE /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 404 len: 111 microversion: 2.1 time: 0.030694 Oct 11 12:11:04.818243 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 429/903] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Oct 11 12:11:04 2022] DELETE /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:11:04.823377 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-0d066e89-363c-43da-b4a9-6fa07bb80937 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:04.823974 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-0d066e89-363c-43da-b4a9-6fa07bb80937 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] [instance: e3277e26-d502-49fd-ba21-b427effd9d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:04.829650 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0d066e89-363c-43da-b4a9-6fa07bb80937 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:04.830130 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0d066e89-363c-43da-b4a9-6fa07bb80937 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:04.830543 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0d066e89-363c-43da-b4a9-6fa07bb80937 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:04.831391 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0d066e89-363c-43da-b4a9-6fa07bb80937 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:04.831672 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0d066e89-363c-43da-b4a9-6fa07bb80937 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:04.832095 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0d066e89-363c-43da-b4a9-6fa07bb80937 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:04.834020 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-b0947acd-eb15-4cd2-b12d-1615af71f85a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:11:04.836373 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:11:04.843640 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b0947acd-eb15-4cd2-b12d-1615af71f85a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1562 microversion: 2.1 time: 0.170844 Oct 11 12:11:04.844202 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 475/904] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:11:04 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1562 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:11:04.848063 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.wsgi [None req-0d066e89-363c-43da-b4a9-6fa07bb80937 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] HTTP exception thrown: Instance e3277e26-d502-49fd-ba21-b427effd9d91 could not be found. Oct 11 12:11:04.849589 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-0d066e89-363c-43da-b4a9-6fa07bb80937 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Request method failure captured: Oct 11 12:11:04.849589 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: request: GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 HTTP/1.1 Oct 11 12:11:04.849589 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept: application/json Oct 11 12:11:04.849589 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept-Encoding: identity Oct 11 12:11:04.849589 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Connection: close Oct 11 12:11:04.849589 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Length: 0 Oct 11 12:11:04.849589 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Type: application/json Oct 11 12:11:04.849589 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Host: 10.222.0.59 Oct 11 12:11:04.849589 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Openstack-System-Scope: None Oct 11 12:11:04.849589 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: User-Agent: python-urllib3/1.26.12 Oct 11 12:11:04.849589 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Auth-Token: gAAAAABjRVs9QtNHBzSTX4aaGIn1kjA3g8hCveim2qiQItdwRP8ypMDo8vouc4V172UwiJwCvsASOxUr3GqC_0b097Blcy0Id7ENCk6xsYTLbUSoUKy0bmF_QHk7OkvwiTjtN93jNN2lvdXFSEWe6-0SgSs_4_52JIjrHwCFI_UNfqPxe1BXzqg Oct 11 12:11:04.849589 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Id: None Oct 11 12:11:04.849589 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Name: None Oct 11 12:11:04.849589 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Identity-Status: Confirmed Oct 11 12:11:04.849589 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Is-Admin-Project: True Oct 11 12:11:04.849589 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Id: default Oct 11 12:11:04.849589 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Name: Default Oct 11 12:11:04.849589 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Id: 9a7beb3a9d2b4ee9ba323d5bccc618c2 Oct 11 12:11:04.849589 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Name: tempest-AttachVolumeTestJSON-2100711064 Oct 11 12:11:04.849589 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Role: reader,member Oct 11 12:11:04.849589 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Roles: reader,member Oct 11 12:11:04.851146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9a7beb3a9d2b4ee9ba323d5bccc618c2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9a7beb3a9d2b4ee9ba323d5bccc618c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a7beb3a9d2b4ee9ba323d5bccc618c2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9a7beb3a9d2b4ee9ba323d5bccc618c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:11:04.851146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant: tempest-AttachVolumeTestJSON-2100711064 Oct 11 12:11:04.851146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Id: 9a7beb3a9d2b4ee9ba323d5bccc618c2 Oct 11 12:11:04.851146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2100711064 Oct 11 12:11:04.851146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User: tempest-AttachVolumeTestJSON-2100711064-project Oct 11 12:11:04.851146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Id: default Oct 11 12:11:04.851146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Name: Default Oct 11 12:11:04.851146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Id: a78e40d4eb554ca49eeec530a7adf428 Oct 11 12:11:04.851146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Name: tempest-AttachVolumeTestJSON-2100711064-project Oct 11 12:11:04.851146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: method: > Oct 11 12:11:04.851146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: exception: Instance e3277e26-d502-49fd-ba21-b427effd9d91 could not be found. Oct 11 12:11:04.851146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: action_args: {'id': 'e3277e26-d502-49fd-ba21-b427effd9d91'} Oct 11 12:11:04.852086 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:11:04.852086 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:11:04.852086 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:11:04.852086 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:11:04.852086 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:11:04.852086 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:11:04.852086 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:11:04.852086 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:11:04.852086 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:11:04.852086 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:11:04.852086 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3277e26-d502-49fd-ba21-b427effd9d91 could not be found. Oct 11 12:11:04.852086 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:11:04.852086 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:11:04.852086 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:11:04.852086 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:11:04.852086 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:11:04.852086 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:11:04.852086 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:11:04.852086 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:11:04.852086 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:11:04.853768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:11:04.853768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 12:11:04.853768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 12:11:04.853768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:11:04.853768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:11:04.853768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:11:04.853768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:11:04.853768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3277e26-d502-49fd-ba21-b427effd9d91 could not be found. Oct 11 12:11:04.853768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:11:04.853768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:11:04.853768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:11:04.853768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:11:04.853768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:11:04.853768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:11:04.853768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:11:04.853768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:11:04.853768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3277e26-d502-49fd-ba21-b427effd9d91 could not be found. Oct 11 12:11:04.853768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:11:04.855424 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-0d066e89-363c-43da-b4a9-6fa07bb80937 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] Returning 404 to user: Instance e3277e26-d502-49fd-ba21-b427effd9d91 could not be found. {{(pid=118994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:11:04.855424 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-0d066e89-363c-43da-b4a9-6fa07bb80937 tempest-AttachVolumeTestJSON-2100711064 tempest-AttachVolumeTestJSON-2100711064-project] 10.222.0.59 "GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91" status: 404 len: 111 microversion: 2.1 time: 0.031276 Oct 11 12:11:04.855424 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 430/905] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:11:04 2022] GET /compute/v2.1/servers/e3277e26-d502-49fd-ba21-b427effd9d91 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:11:39.048035 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b99a5c53-39dd-49c6-8e50-e466780bb0e2 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Action: 'create', calling method: .version_select at 0x7fd40655d430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1069425504", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvIitgYyT+j3hx1vI6AlMk4uCWzoDSxVisZVxAPjLwvsoN0lyEkyIf38AN/nwa5EvKhEAuti5JUURP/9iYDcFVqAR9pQpTl3tnvLePPBLuWBtdA2IOnQkfAo8TSoSXlzw=="}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:11:39.054263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 12:11:39.054416 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Tue Oct 11 12:11:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.59) !!! Oct 11 12:11:39.056143 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=11 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:11:39.070904 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-b99a5c53-39dd-49c6-8e50-e466780bb0e2 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Getting quotas for project f48db192fac04a06932590c23b751595. Resources: {'key_pairs'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 12:11:39.074802 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-b99a5c53-39dd-49c6-8e50-e466780bb0e2 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Getting quotas for user 33ade5d60ccb44bab2e8ee2f0b21e456 and project f48db192fac04a06932590c23b751595. Resources: {'key_pairs'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 12:11:39.101053 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b99a5c53-39dd-49c6-8e50-e466780bb0e2 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.056979 Oct 11 12:11:39.101649 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 476/906] 10.222.0.59 () {60 vars in 1159 bytes} [Tue Oct 11 12:11:39 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:11:39.155784 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-f0841d1f-81f5-4c42-bb38-a9b06bb784c6 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1726805874", "imageRef": "60d9b2ed-6f6f-40ac-9a52-8c6c82396595", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1069425504", "networks": [{"uuid": "f048234f-8970-450e-bb74-f1fba7d42203"}]}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:11:39.165113 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:11:39.165776 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=16 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:11:39.210262 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.network.neutron [None req-f0841d1f-81f5-4c42-bb38-a9b06bb784c6 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] validate_networks() for [('f048234f-8970-450e-bb74-f1fba7d42203', None, None, None, None, None)] {{(pid=118994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 12:11:39.737716 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-f0841d1f-81f5-4c42-bb38-a9b06bb784c6 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Flavor limits 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 12:11:39.738253 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-f0841d1f-81f5-4c42-bb38-a9b06bb784c6 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Image limits 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 12:11:39.738843 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-f0841d1f-81f5-4c42-bb38-a9b06bb784c6 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Flavor pref 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 12:11:39.739427 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-f0841d1f-81f5-4c42-bb38-a9b06bb784c6 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Image pref 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 12:11:39.740258 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-f0841d1f-81f5-4c42-bb38-a9b06bb784c6 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 12:11:39.754953 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f0841d1f-81f5-4c42-bb38-a9b06bb784c6 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:39.755355 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f0841d1f-81f5-4c42-bb38-a9b06bb784c6 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:39.755782 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f0841d1f-81f5-4c42-bb38-a9b06bb784c6 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:39.756506 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f0841d1f-81f5-4c42-bb38-a9b06bb784c6 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:39.756950 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f0841d1f-81f5-4c42-bb38-a9b06bb784c6 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:39.757368 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f0841d1f-81f5-4c42-bb38-a9b06bb784c6 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:39.777940 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-f0841d1f-81f5-4c42-bb38-a9b06bb784c6 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Getting quotas for project f48db192fac04a06932590c23b751595. Resources: {'ram', 'instances', 'cores'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 12:11:39.784145 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-f0841d1f-81f5-4c42-bb38-a9b06bb784c6 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Getting quotas for user 33ade5d60ccb44bab2e8ee2f0b21e456 and project f48db192fac04a06932590c23b751595. Resources: {'ram', 'instances', 'cores'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 12:11:39.797927 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-f0841d1f-81f5-4c42-bb38-a9b06bb784c6 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Going to run 1 instances... {{(pid=118994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 12:11:39.800247 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-f0841d1f-81f5-4c42-bb38-a9b06bb784c6 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='60d9b2ed-6f6f-40ac-9a52-8c6c82396595',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 12:11:39.848669 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-f0841d1f-81f5-4c42-bb38-a9b06bb784c6 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.696875 Oct 11 12:11:39.849652 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 431/907] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Oct 11 12:11:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 698 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 12:11:39.860761 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a71945c9-7b69-4198-93ad-2f780171a590 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:39.861585 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a71945c9-7b69-4198-93ad-2f780171a590 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:39.941819 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a71945c9-7b69-4198-93ad-2f780171a590 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:11:39.951425 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a71945c9-7b69-4198-93ad-2f780171a590 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1259 microversion: 2.1 time: 0.094308 Oct 11 12:11:39.954736 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 477/908] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:11:39 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1259 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:11:40.973590 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-0c049252-d789-4312-8fa5-9692813bf0d3 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:40.974208 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-0c049252-d789-4312-8fa5-9692813bf0d3 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:40.981417 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0c049252-d789-4312-8fa5-9692813bf0d3 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:40.981900 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0c049252-d789-4312-8fa5-9692813bf0d3 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:40.982333 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0c049252-d789-4312-8fa5-9692813bf0d3 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:40.983081 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0c049252-d789-4312-8fa5-9692813bf0d3 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:40.983528 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0c049252-d789-4312-8fa5-9692813bf0d3 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:40.983935 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0c049252-d789-4312-8fa5-9692813bf0d3 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:41.048788 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-0c049252-d789-4312-8fa5-9692813bf0d3 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:11:41.057016 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-0c049252-d789-4312-8fa5-9692813bf0d3 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1311 microversion: 2.1 time: 0.087340 Oct 11 12:11:41.057616 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 432/909] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:11:40 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1311 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:11:42.080360 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5340e8fd-1a9b-45e2-8275-092634f58375 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:42.080933 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-5340e8fd-1a9b-45e2-8275-092634f58375 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:42.092905 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5340e8fd-1a9b-45e2-8275-092634f58375 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:42.093396 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5340e8fd-1a9b-45e2-8275-092634f58375 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:42.093842 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5340e8fd-1a9b-45e2-8275-092634f58375 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:42.100813 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5340e8fd-1a9b-45e2-8275-092634f58375 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:42.101353 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5340e8fd-1a9b-45e2-8275-092634f58375 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:42.101799 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5340e8fd-1a9b-45e2-8275-092634f58375 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:42.319253 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5340e8fd-1a9b-45e2-8275-092634f58375 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:11:42.332539 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5340e8fd-1a9b-45e2-8275-092634f58375 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1359 microversion: 2.1 time: 0.256010 Oct 11 12:11:42.333955 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 478/910] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:11:42 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1359 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:11:43.359124 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-c54bf173-fd11-44d5-b944-00e763293ac1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:43.360665 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-c54bf173-fd11-44d5-b944-00e763293ac1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:43.368087 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c54bf173-fd11-44d5-b944-00e763293ac1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:43.369063 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c54bf173-fd11-44d5-b944-00e763293ac1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:43.369431 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c54bf173-fd11-44d5-b944-00e763293ac1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:43.370359 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c54bf173-fd11-44d5-b944-00e763293ac1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:43.371031 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c54bf173-fd11-44d5-b944-00e763293ac1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:43.371666 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c54bf173-fd11-44d5-b944-00e763293ac1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:43.523922 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-c54bf173-fd11-44d5-b944-00e763293ac1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:11:43.536086 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-c54bf173-fd11-44d5-b944-00e763293ac1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1359 microversion: 2.1 time: 0.181092 Oct 11 12:11:43.536899 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 433/911] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:11:43 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:11:44.563313 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c727bd9f-32a0-4476-ab8c-0cae8e6b93de tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:44.564098 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c727bd9f-32a0-4476-ab8c-0cae8e6b93de tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:44.570895 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c727bd9f-32a0-4476-ab8c-0cae8e6b93de tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:44.571368 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c727bd9f-32a0-4476-ab8c-0cae8e6b93de tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:44.571829 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c727bd9f-32a0-4476-ab8c-0cae8e6b93de tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:44.572512 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c727bd9f-32a0-4476-ab8c-0cae8e6b93de tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:44.572956 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c727bd9f-32a0-4476-ab8c-0cae8e6b93de tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:44.573368 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c727bd9f-32a0-4476-ab8c-0cae8e6b93de tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:44.720171 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c727bd9f-32a0-4476-ab8c-0cae8e6b93de tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:11:44.728860 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c727bd9f-32a0-4476-ab8c-0cae8e6b93de tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1359 microversion: 2.1 time: 0.173651 Oct 11 12:11:44.729499 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 479/912] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:11:44 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:11:45.161633 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-8df482c5-cfec-4c29-9bca-c77a2ad5c24a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:45.163360 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-8df482c5-cfec-4c29-9bca-c77a2ad5c24a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:45.171073 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8df482c5-cfec-4c29-9bca-c77a2ad5c24a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:45.171861 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8df482c5-cfec-4c29-9bca-c77a2ad5c24a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:45.172273 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8df482c5-cfec-4c29-9bca-c77a2ad5c24a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:45.173433 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8df482c5-cfec-4c29-9bca-c77a2ad5c24a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:45.174056 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8df482c5-cfec-4c29-9bca-c77a2ad5c24a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:45.174485 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8df482c5-cfec-4c29-9bca-c77a2ad5c24a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:45.205530 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-8df482c5-cfec-4c29-9bca-c77a2ad5c24a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments/1366d85e-82bc-425a-8818-6f0a541c41ac" status: 200 len: 194 microversion: 2.20 time: 0.048289 Oct 11 12:11:45.206745 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 434/913] 10.222.0.59 () {60 vars in 1454 bytes} [Tue Oct 11 12:11:45 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments/1366d85e-82bc-425a-8818-6f0a541c41ac => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 12:11:45.281505 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-da672e03-bc2e-4cf3-a7d1-db50e4090205 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:45.281994 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-da672e03-bc2e-4cf3-a7d1-db50e4090205 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:45.288582 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-da672e03-bc2e-4cf3-a7d1-db50e4090205 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:45.289040 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-da672e03-bc2e-4cf3-a7d1-db50e4090205 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:45.289474 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-da672e03-bc2e-4cf3-a7d1-db50e4090205 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:45.290178 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-da672e03-bc2e-4cf3-a7d1-db50e4090205 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:45.290657 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-da672e03-bc2e-4cf3-a7d1-db50e4090205 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:45.291286 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-da672e03-bc2e-4cf3-a7d1-db50e4090205 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:45.379924 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-da672e03-bc2e-4cf3-a7d1-db50e4090205 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lazy-loading 'services' on Instance uuid 2f1f910a-6135-426a-97a7-570948cf922c {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:11:45.458487 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-da672e03-bc2e-4cf3-a7d1-db50e4090205 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments/1366d85e-82bc-425a-8818-6f0a541c41ac" status: 202 len: 0 microversion: 2.20 time: 0.180908 Oct 11 12:11:45.459285 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 480/914] 10.222.0.59 () {60 vars in 1457 bytes} [Tue Oct 11 12:11:45 2022] DELETE /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments/1366d85e-82bc-425a-8818-6f0a541c41ac => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 12:11:45.467718 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-44a52bc0-7d33-414d-8e71-3c6d5f8f0f9e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:45.469982 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-44a52bc0-7d33-414d-8e71-3c6d5f8f0f9e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:45.476570 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-44a52bc0-7d33-414d-8e71-3c6d5f8f0f9e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:45.477052 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-44a52bc0-7d33-414d-8e71-3c6d5f8f0f9e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:45.477481 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-44a52bc0-7d33-414d-8e71-3c6d5f8f0f9e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:45.478175 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-44a52bc0-7d33-414d-8e71-3c6d5f8f0f9e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:45.478658 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-44a52bc0-7d33-414d-8e71-3c6d5f8f0f9e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:45.479078 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-44a52bc0-7d33-414d-8e71-3c6d5f8f0f9e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:45.509885 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-44a52bc0-7d33-414d-8e71-3c6d5f8f0f9e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046116 Oct 11 12:11:45.510456 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 435/915] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Oct 11 12:11:45 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 12:11:45.757895 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-4e10ab68-7257-4b25-82dc-3223aeb61fd1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:45.758623 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-4e10ab68-7257-4b25-82dc-3223aeb61fd1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:45.765185 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4e10ab68-7257-4b25-82dc-3223aeb61fd1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:45.765673 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4e10ab68-7257-4b25-82dc-3223aeb61fd1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:45.766107 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4e10ab68-7257-4b25-82dc-3223aeb61fd1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:45.766838 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4e10ab68-7257-4b25-82dc-3223aeb61fd1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:45.767290 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4e10ab68-7257-4b25-82dc-3223aeb61fd1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:45.768030 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4e10ab68-7257-4b25-82dc-3223aeb61fd1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:45.910645 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-4e10ab68-7257-4b25-82dc-3223aeb61fd1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:11:45.918995 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-4e10ab68-7257-4b25-82dc-3223aeb61fd1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1359 microversion: 2.1 time: 0.165761 Oct 11 12:11:45.919609 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 481/916] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:11:45 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:11:46.523771 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-38cb6f1e-6da1-4c9c-8880-b5c2271ef0d1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:46.526005 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-38cb6f1e-6da1-4c9c-8880-b5c2271ef0d1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:46.534035 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-38cb6f1e-6da1-4c9c-8880-b5c2271ef0d1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:46.534675 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-38cb6f1e-6da1-4c9c-8880-b5c2271ef0d1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:46.535275 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-38cb6f1e-6da1-4c9c-8880-b5c2271ef0d1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:46.535982 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-38cb6f1e-6da1-4c9c-8880-b5c2271ef0d1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:46.536511 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-38cb6f1e-6da1-4c9c-8880-b5c2271ef0d1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:46.536847 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-38cb6f1e-6da1-4c9c-8880-b5c2271ef0d1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:46.569984 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-38cb6f1e-6da1-4c9c-8880-b5c2271ef0d1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050619 Oct 11 12:11:46.570602 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 436/917] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Oct 11 12:11:46 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 12:11:46.941588 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-34192890-6fb3-4062-a94b-82060b89c460 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:46.942286 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-34192890-6fb3-4062-a94b-82060b89c460 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:46.949445 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-34192890-6fb3-4062-a94b-82060b89c460 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:46.949916 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-34192890-6fb3-4062-a94b-82060b89c460 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:46.950342 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-34192890-6fb3-4062-a94b-82060b89c460 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:46.951031 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-34192890-6fb3-4062-a94b-82060b89c460 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:46.951472 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-34192890-6fb3-4062-a94b-82060b89c460 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:46.951883 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-34192890-6fb3-4062-a94b-82060b89c460 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:47.090847 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-34192890-6fb3-4062-a94b-82060b89c460 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:11:47.098640 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-34192890-6fb3-4062-a94b-82060b89c460 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1359 microversion: 2.1 time: 0.160967 Oct 11 12:11:47.099212 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 482/918] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:11:46 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:11:47.585229 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-d5cca1d6-0b10-4ef1-a510-2eb1c39bfc58 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:47.587806 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-d5cca1d6-0b10-4ef1-a510-2eb1c39bfc58 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:47.594848 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d5cca1d6-0b10-4ef1-a510-2eb1c39bfc58 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:47.595324 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d5cca1d6-0b10-4ef1-a510-2eb1c39bfc58 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:47.595751 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d5cca1d6-0b10-4ef1-a510-2eb1c39bfc58 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:47.596446 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d5cca1d6-0b10-4ef1-a510-2eb1c39bfc58 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:47.596892 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d5cca1d6-0b10-4ef1-a510-2eb1c39bfc58 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:47.597309 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d5cca1d6-0b10-4ef1-a510-2eb1c39bfc58 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:47.628480 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-d5cca1d6-0b10-4ef1-a510-2eb1c39bfc58 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048360 Oct 11 12:11:47.629436 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 437/919] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Oct 11 12:11:47 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 12:11:48.122983 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f6d603a3-1ba7-4c8e-8f20-c48202cd48a1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:48.124334 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f6d603a3-1ba7-4c8e-8f20-c48202cd48a1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:48.131249 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f6d603a3-1ba7-4c8e-8f20-c48202cd48a1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:48.131736 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f6d603a3-1ba7-4c8e-8f20-c48202cd48a1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:48.132170 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f6d603a3-1ba7-4c8e-8f20-c48202cd48a1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:48.133172 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f6d603a3-1ba7-4c8e-8f20-c48202cd48a1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:48.133627 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f6d603a3-1ba7-4c8e-8f20-c48202cd48a1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:48.134050 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f6d603a3-1ba7-4c8e-8f20-c48202cd48a1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:48.269049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f6d603a3-1ba7-4c8e-8f20-c48202cd48a1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:11:48.277490 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f6d603a3-1ba7-4c8e-8f20-c48202cd48a1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1359 microversion: 2.1 time: 0.159597 Oct 11 12:11:48.287003 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 483/920] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:11:48 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:11:48.643982 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-60b56978-3071-44cb-8034-3afe1b017e2f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:48.646831 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-60b56978-3071-44cb-8034-3afe1b017e2f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:48.653382 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-60b56978-3071-44cb-8034-3afe1b017e2f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:48.653852 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-60b56978-3071-44cb-8034-3afe1b017e2f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:48.654280 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-60b56978-3071-44cb-8034-3afe1b017e2f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:48.655184 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-60b56978-3071-44cb-8034-3afe1b017e2f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:48.655634 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-60b56978-3071-44cb-8034-3afe1b017e2f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:48.656056 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-60b56978-3071-44cb-8034-3afe1b017e2f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:48.687556 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-60b56978-3071-44cb-8034-3afe1b017e2f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047844 Oct 11 12:11:48.688085 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 438/921] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Oct 11 12:11:48 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 12:11:49.304807 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8d125ad9-1ceb-4e8e-918a-bb432d211f69 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:49.305661 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8d125ad9-1ceb-4e8e-918a-bb432d211f69 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:49.314990 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d125ad9-1ceb-4e8e-918a-bb432d211f69 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:49.315748 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d125ad9-1ceb-4e8e-918a-bb432d211f69 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:49.316338 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d125ad9-1ceb-4e8e-918a-bb432d211f69 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:49.317362 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d125ad9-1ceb-4e8e-918a-bb432d211f69 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:49.317930 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d125ad9-1ceb-4e8e-918a-bb432d211f69 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:49.318394 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8d125ad9-1ceb-4e8e-918a-bb432d211f69 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:49.477472 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8d125ad9-1ceb-4e8e-918a-bb432d211f69 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:11:49.485187 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8d125ad9-1ceb-4e8e-918a-bb432d211f69 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1359 microversion: 2.1 time: 0.186885 Oct 11 12:11:49.485742 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 484/922] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:11:49 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:11:49.702270 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-670a4f6d-aaff-47a8-9cdf-5ca9ab25ed90 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:49.705127 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-670a4f6d-aaff-47a8-9cdf-5ca9ab25ed90 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:49.711897 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-670a4f6d-aaff-47a8-9cdf-5ca9ab25ed90 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:49.712677 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-670a4f6d-aaff-47a8-9cdf-5ca9ab25ed90 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:49.713103 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-670a4f6d-aaff-47a8-9cdf-5ca9ab25ed90 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:49.713796 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-670a4f6d-aaff-47a8-9cdf-5ca9ab25ed90 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:49.714293 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-670a4f6d-aaff-47a8-9cdf-5ca9ab25ed90 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:49.714739 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-670a4f6d-aaff-47a8-9cdf-5ca9ab25ed90 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:49.744070 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-670a4f6d-aaff-47a8-9cdf-5ca9ab25ed90 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047221 Oct 11 12:11:49.744622 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 439/923] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Oct 11 12:11:49 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 12:11:50.511098 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6af8bf9c-e3d9-41b1-92f1-e744bea556a6 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:50.511813 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-6af8bf9c-e3d9-41b1-92f1-e744bea556a6 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:50.514157 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=6 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:11:50.521849 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6af8bf9c-e3d9-41b1-92f1-e744bea556a6 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:50.522337 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6af8bf9c-e3d9-41b1-92f1-e744bea556a6 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:50.522796 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6af8bf9c-e3d9-41b1-92f1-e744bea556a6 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:50.523501 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6af8bf9c-e3d9-41b1-92f1-e744bea556a6 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:50.524131 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6af8bf9c-e3d9-41b1-92f1-e744bea556a6 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:50.524713 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6af8bf9c-e3d9-41b1-92f1-e744bea556a6 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:50.666077 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6af8bf9c-e3d9-41b1-92f1-e744bea556a6 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:11:50.676373 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6af8bf9c-e3d9-41b1-92f1-e744bea556a6 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1359 microversion: 2.1 time: 0.170892 Oct 11 12:11:50.676972 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 485/924] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:11:50 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:11:50.757122 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-e27eafc3-ca6c-41c1-9267-e827bad00298 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:50.760306 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-e27eafc3-ca6c-41c1-9267-e827bad00298 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:50.763826 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell0:SELECT=2 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:11:50.764432 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell0:SELECT=6 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:11:50.770600 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e27eafc3-ca6c-41c1-9267-e827bad00298 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:50.771461 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e27eafc3-ca6c-41c1-9267-e827bad00298 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:50.772061 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e27eafc3-ca6c-41c1-9267-e827bad00298 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:50.772962 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e27eafc3-ca6c-41c1-9267-e827bad00298 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:50.773404 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e27eafc3-ca6c-41c1-9267-e827bad00298 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:50.774019 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e27eafc3-ca6c-41c1-9267-e827bad00298 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:50.826218 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-e27eafc3-ca6c-41c1-9267-e827bad00298 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.073086 Oct 11 12:11:50.826852 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 440/925] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Oct 11 12:11:50 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 12:11:51.701597 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-91b10d87-e86f-488c-8795-fd060ea5fa0a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:51.702243 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-91b10d87-e86f-488c-8795-fd060ea5fa0a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:51.709043 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-91b10d87-e86f-488c-8795-fd060ea5fa0a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:51.709527 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-91b10d87-e86f-488c-8795-fd060ea5fa0a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:51.709953 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-91b10d87-e86f-488c-8795-fd060ea5fa0a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:51.710682 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-91b10d87-e86f-488c-8795-fd060ea5fa0a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:51.711132 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-91b10d87-e86f-488c-8795-fd060ea5fa0a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:51.711546 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-91b10d87-e86f-488c-8795-fd060ea5fa0a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:51.838352 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-2a23c839-049b-4e3b-9ac8-7f22c91883f7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:51.840490 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-2a23c839-049b-4e3b-9ac8-7f22c91883f7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:51.847560 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2a23c839-049b-4e3b-9ac8-7f22c91883f7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:51.848083 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2a23c839-049b-4e3b-9ac8-7f22c91883f7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:51.848513 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2a23c839-049b-4e3b-9ac8-7f22c91883f7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:51.849207 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2a23c839-049b-4e3b-9ac8-7f22c91883f7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:51.849655 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2a23c839-049b-4e3b-9ac8-7f22c91883f7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:51.850890 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2a23c839-049b-4e3b-9ac8-7f22c91883f7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:51.852726 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-91b10d87-e86f-488c-8795-fd060ea5fa0a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:11:51.860543 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-91b10d87-e86f-488c-8795-fd060ea5fa0a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1359 microversion: 2.1 time: 0.162956 Oct 11 12:11:51.861117 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 486/926] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:11:51 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:11:51.882079 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-2a23c839-049b-4e3b-9ac8-7f22c91883f7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047750 Oct 11 12:11:51.882648 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 441/927] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Oct 11 12:11:51 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 12:11:52.884569 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d3f29f50-beb9-4202-9248-4d848c851f09 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:52.885191 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d3f29f50-beb9-4202-9248-4d848c851f09 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:52.892315 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d3f29f50-beb9-4202-9248-4d848c851f09 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:52.893109 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d3f29f50-beb9-4202-9248-4d848c851f09 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:52.893540 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d3f29f50-beb9-4202-9248-4d848c851f09 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:52.894225 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d3f29f50-beb9-4202-9248-4d848c851f09 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:52.894768 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d3f29f50-beb9-4202-9248-4d848c851f09 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:52.895180 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d3f29f50-beb9-4202-9248-4d848c851f09 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:52.895643 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-49457377-5f5c-41cc-94c2-7da6a3ed24ab tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:52.897815 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-49457377-5f5c-41cc-94c2-7da6a3ed24ab tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:52.904557 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-49457377-5f5c-41cc-94c2-7da6a3ed24ab tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:52.905013 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-49457377-5f5c-41cc-94c2-7da6a3ed24ab tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:52.905438 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-49457377-5f5c-41cc-94c2-7da6a3ed24ab tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:52.906122 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-49457377-5f5c-41cc-94c2-7da6a3ed24ab tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:52.906580 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-49457377-5f5c-41cc-94c2-7da6a3ed24ab tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:52.907081 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-49457377-5f5c-41cc-94c2-7da6a3ed24ab tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:52.938081 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-49457377-5f5c-41cc-94c2-7da6a3ed24ab tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046866 Oct 11 12:11:52.938706 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 442/928] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Oct 11 12:11:52 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 12:11:53.047659 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d3f29f50-beb9-4202-9248-4d848c851f09 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:11:53.057367 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d3f29f50-beb9-4202-9248-4d848c851f09 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1359 microversion: 2.1 time: 0.176734 Oct 11 12:11:53.057935 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 487/929] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:11:52 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:11:53.951269 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-dda4dcf7-599c-4aef-bc80-adafc8a5b77e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:53.953431 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-dda4dcf7-599c-4aef-bc80-adafc8a5b77e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:53.963371 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-dda4dcf7-599c-4aef-bc80-adafc8a5b77e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:53.963862 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-dda4dcf7-599c-4aef-bc80-adafc8a5b77e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:53.964292 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-dda4dcf7-599c-4aef-bc80-adafc8a5b77e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:53.965001 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-dda4dcf7-599c-4aef-bc80-adafc8a5b77e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:53.965449 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-dda4dcf7-599c-4aef-bc80-adafc8a5b77e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:53.965859 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-dda4dcf7-599c-4aef-bc80-adafc8a5b77e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:53.997233 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-dda4dcf7-599c-4aef-bc80-adafc8a5b77e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049999 Oct 11 12:11:53.997790 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 443/930] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Oct 11 12:11:53 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 12:11:54.082128 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-eed3ff68-6abf-4874-969c-ef49dd97f0f3 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:54.082835 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-eed3ff68-6abf-4874-969c-ef49dd97f0f3 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:54.090996 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eed3ff68-6abf-4874-969c-ef49dd97f0f3 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:54.091557 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eed3ff68-6abf-4874-969c-ef49dd97f0f3 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:54.092054 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eed3ff68-6abf-4874-969c-ef49dd97f0f3 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:54.092847 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eed3ff68-6abf-4874-969c-ef49dd97f0f3 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:54.093367 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eed3ff68-6abf-4874-969c-ef49dd97f0f3 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:54.093851 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eed3ff68-6abf-4874-969c-ef49dd97f0f3 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:54.239781 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-eed3ff68-6abf-4874-969c-ef49dd97f0f3 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:11:54.249039 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-eed3ff68-6abf-4874-969c-ef49dd97f0f3 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1359 microversion: 2.1 time: 0.171403 Oct 11 12:11:54.249692 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 488/931] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:11:54 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:11:55.013235 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-8be1dae2-8acd-467b-ad22-ad788ddd369a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:55.016323 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-8be1dae2-8acd-467b-ad22-ad788ddd369a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:55.025437 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8be1dae2-8acd-467b-ad22-ad788ddd369a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:55.025911 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8be1dae2-8acd-467b-ad22-ad788ddd369a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:55.026336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8be1dae2-8acd-467b-ad22-ad788ddd369a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:55.027064 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8be1dae2-8acd-467b-ad22-ad788ddd369a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:55.027494 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8be1dae2-8acd-467b-ad22-ad788ddd369a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:55.027908 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8be1dae2-8acd-467b-ad22-ad788ddd369a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:55.058534 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-8be1dae2-8acd-467b-ad22-ad788ddd369a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051765 Oct 11 12:11:55.059119 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 444/932] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Oct 11 12:11:55 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 12:11:55.279370 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5b4fdbbd-51f0-49ba-839f-8f46c0c1929d tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:55.279939 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-5b4fdbbd-51f0-49ba-839f-8f46c0c1929d tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:55.286823 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5b4fdbbd-51f0-49ba-839f-8f46c0c1929d tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:55.287311 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5b4fdbbd-51f0-49ba-839f-8f46c0c1929d tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:55.287740 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5b4fdbbd-51f0-49ba-839f-8f46c0c1929d tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:55.288432 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5b4fdbbd-51f0-49ba-839f-8f46c0c1929d tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:55.288852 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5b4fdbbd-51f0-49ba-839f-8f46c0c1929d tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:55.289309 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5b4fdbbd-51f0-49ba-839f-8f46c0c1929d tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:55.425572 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5b4fdbbd-51f0-49ba-839f-8f46c0c1929d tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:11:55.433408 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5b4fdbbd-51f0-49ba-839f-8f46c0c1929d tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1359 microversion: 2.1 time: 0.158113 Oct 11 12:11:55.433970 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 489/933] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:11:55 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:11:56.078385 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-3f254b7a-a56e-4f0a-9209-6b2caf399909 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:56.091592 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-3f254b7a-a56e-4f0a-9209-6b2caf399909 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:56.099922 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3f254b7a-a56e-4f0a-9209-6b2caf399909 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:56.100415 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3f254b7a-a56e-4f0a-9209-6b2caf399909 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:56.100848 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3f254b7a-a56e-4f0a-9209-6b2caf399909 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:56.101561 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3f254b7a-a56e-4f0a-9209-6b2caf399909 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:56.102017 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3f254b7a-a56e-4f0a-9209-6b2caf399909 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:56.102439 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3f254b7a-a56e-4f0a-9209-6b2caf399909 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:56.135290 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-3f254b7a-a56e-4f0a-9209-6b2caf399909 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.061510 Oct 11 12:11:56.135863 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 445/934] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Oct 11 12:11:56 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 12:11:56.456460 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-010a382b-082e-4949-b1dd-148fa850173d tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:56.457071 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-010a382b-082e-4949-b1dd-148fa850173d tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:56.464033 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-010a382b-082e-4949-b1dd-148fa850173d tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:56.464513 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-010a382b-082e-4949-b1dd-148fa850173d tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:56.464943 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-010a382b-082e-4949-b1dd-148fa850173d tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:56.465633 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-010a382b-082e-4949-b1dd-148fa850173d tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:56.466081 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-010a382b-082e-4949-b1dd-148fa850173d tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:56.466500 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-010a382b-082e-4949-b1dd-148fa850173d tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:56.601663 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-010a382b-082e-4949-b1dd-148fa850173d tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:11:56.613106 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-010a382b-082e-4949-b1dd-148fa850173d tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1359 microversion: 2.1 time: 0.160499 Oct 11 12:11:56.613672 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 490/935] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:11:56 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:11:57.149263 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-b6d01679-bb5e-4b67-b6f4-ee88dcc145d2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:57.152012 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-b6d01679-bb5e-4b67-b6f4-ee88dcc145d2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:57.159857 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b6d01679-bb5e-4b67-b6f4-ee88dcc145d2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:57.160336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b6d01679-bb5e-4b67-b6f4-ee88dcc145d2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:57.160790 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b6d01679-bb5e-4b67-b6f4-ee88dcc145d2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:57.161574 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b6d01679-bb5e-4b67-b6f4-ee88dcc145d2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:57.162021 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b6d01679-bb5e-4b67-b6f4-ee88dcc145d2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:57.162467 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b6d01679-bb5e-4b67-b6f4-ee88dcc145d2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:57.193527 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-b6d01679-bb5e-4b67-b6f4-ee88dcc145d2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048623 Oct 11 12:11:57.194096 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 446/936] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Oct 11 12:11:57 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 12:11:57.638206 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2b28c498-8145-476a-94c8-b74911deb3eb tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:57.638829 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2b28c498-8145-476a-94c8-b74911deb3eb tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:57.646072 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2b28c498-8145-476a-94c8-b74911deb3eb tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:57.646544 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2b28c498-8145-476a-94c8-b74911deb3eb tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:57.646999 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2b28c498-8145-476a-94c8-b74911deb3eb tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:57.647683 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2b28c498-8145-476a-94c8-b74911deb3eb tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:57.648125 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2b28c498-8145-476a-94c8-b74911deb3eb tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:57.648537 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2b28c498-8145-476a-94c8-b74911deb3eb tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:57.802672 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2b28c498-8145-476a-94c8-b74911deb3eb tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:11:57.814892 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2b28c498-8145-476a-94c8-b74911deb3eb tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1359 microversion: 2.1 time: 0.180721 Oct 11 12:11:57.815763 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 491/937] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:11:57 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1359 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:11:58.207418 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-74e2acd5-2488-4d5e-9795-90c69a95e526 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:58.209554 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-74e2acd5-2488-4d5e-9795-90c69a95e526 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:58.216603 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-74e2acd5-2488-4d5e-9795-90c69a95e526 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:58.217011 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-74e2acd5-2488-4d5e-9795-90c69a95e526 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:58.217407 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-74e2acd5-2488-4d5e-9795-90c69a95e526 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:58.218114 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-74e2acd5-2488-4d5e-9795-90c69a95e526 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:58.218618 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-74e2acd5-2488-4d5e-9795-90c69a95e526 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:58.219019 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-74e2acd5-2488-4d5e-9795-90c69a95e526 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:58.248739 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-74e2acd5-2488-4d5e-9795-90c69a95e526 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045426 Oct 11 12:11:58.249314 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 447/938] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Oct 11 12:11:58 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 12:11:58.840551 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e13dca2f-4d63-482b-89c2-420bf81001c2 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:58.841142 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e13dca2f-4d63-482b-89c2-420bf81001c2 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:58.847964 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e13dca2f-4d63-482b-89c2-420bf81001c2 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:58.848445 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e13dca2f-4d63-482b-89c2-420bf81001c2 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:58.848870 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e13dca2f-4d63-482b-89c2-420bf81001c2 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:58.849554 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e13dca2f-4d63-482b-89c2-420bf81001c2 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:58.849993 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e13dca2f-4d63-482b-89c2-420bf81001c2 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:58.850413 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e13dca2f-4d63-482b-89c2-420bf81001c2 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:58.982440 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e13dca2f-4d63-482b-89c2-420bf81001c2 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:11:58.990513 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e13dca2f-4d63-482b-89c2-420bf81001c2 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1359 microversion: 2.1 time: 0.153830 Oct 11 12:11:58.991061 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 492/939] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:11:58 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:11:59.263870 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-ccefb5d6-5bff-4fb8-94f9-a27661a2db6c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:11:59.265951 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-ccefb5d6-5bff-4fb8-94f9-a27661a2db6c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:11:59.273200 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ccefb5d6-5bff-4fb8-94f9-a27661a2db6c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:59.273687 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ccefb5d6-5bff-4fb8-94f9-a27661a2db6c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:59.274120 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ccefb5d6-5bff-4fb8-94f9-a27661a2db6c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:59.274857 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ccefb5d6-5bff-4fb8-94f9-a27661a2db6c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:11:59.275311 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ccefb5d6-5bff-4fb8-94f9-a27661a2db6c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:11:59.275737 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ccefb5d6-5bff-4fb8-94f9-a27661a2db6c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:11:59.279560 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=100 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:11:59.306406 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-ccefb5d6-5bff-4fb8-94f9-a27661a2db6c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046849 Oct 11 12:11:59.307035 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 448/940] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Oct 11 12:11:59 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 12:12:00.014698 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-dc6d172e-6238-44bf-8859-cfa2bcca8b94 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:00.015327 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-dc6d172e-6238-44bf-8859-cfa2bcca8b94 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:00.026893 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dc6d172e-6238-44bf-8859-cfa2bcca8b94 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:00.027734 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dc6d172e-6238-44bf-8859-cfa2bcca8b94 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:00.028311 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dc6d172e-6238-44bf-8859-cfa2bcca8b94 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:00.029244 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dc6d172e-6238-44bf-8859-cfa2bcca8b94 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:00.029759 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dc6d172e-6238-44bf-8859-cfa2bcca8b94 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:00.030181 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-dc6d172e-6238-44bf-8859-cfa2bcca8b94 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:00.049115 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-370b16d7-56e9-400b-9abc-2ceed13fce3e req-8b3dda71-105e-40b6-9038-d7aa769d3dd3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fa95338-071a-4ea3-9562-c37c74c182ac", "tag": "91b90de7-e871-422f-a2ac-9331cb77b634"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:12:00.058920 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-370b16d7-56e9-400b-9abc-2ceed13fce3e req-8b3dda71-105e-40b6-9038-d7aa769d3dd3 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:00.059282 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-370b16d7-56e9-400b-9abc-2ceed13fce3e req-8b3dda71-105e-40b6-9038-d7aa769d3dd3 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:00.059704 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-370b16d7-56e9-400b-9abc-2ceed13fce3e req-8b3dda71-105e-40b6-9038-d7aa769d3dd3 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:00.071110 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-370b16d7-56e9-400b-9abc-2ceed13fce3e req-8b3dda71-105e-40b6-9038-d7aa769d3dd3 service nova] Creating event network-changed:91b90de7-e871-422f-a2ac-9331cb77b634 for instance 2fa95338-071a-4ea3-9562-c37c74c182ac on hv-cinder-82099 Oct 11 12:12:00.076126 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-370b16d7-56e9-400b-9abc-2ceed13fce3e req-8b3dda71-105e-40b6-9038-d7aa769d3dd3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031040 Oct 11 12:12:00.077075 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 449/941] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:12:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 12:12:00.183848 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-dc6d172e-6238-44bf-8859-cfa2bcca8b94 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:00.186047 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:12:00.194085 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-dc6d172e-6238-44bf-8859-cfa2bcca8b94 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1359 microversion: 2.1 time: 0.184229 Oct 11 12:12:00.194812 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 493/942] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:12:00 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:12:00.320238 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-d6c1e714-7648-4650-9eb5-beb1ad58e55e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:00.322480 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-d6c1e714-7648-4650-9eb5-beb1ad58e55e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:00.329695 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d6c1e714-7648-4650-9eb5-beb1ad58e55e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:00.330257 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d6c1e714-7648-4650-9eb5-beb1ad58e55e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:00.330914 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d6c1e714-7648-4650-9eb5-beb1ad58e55e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:00.331687 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d6c1e714-7648-4650-9eb5-beb1ad58e55e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:00.332239 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d6c1e714-7648-4650-9eb5-beb1ad58e55e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:00.332905 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d6c1e714-7648-4650-9eb5-beb1ad58e55e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:00.364384 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-d6c1e714-7648-4650-9eb5-beb1ad58e55e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049093 Oct 11 12:12:00.365291 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 450/943] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Oct 11 12:12:00 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 12:12:01.218777 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0f7d0a0d-1a04-4873-816a-8652d519bc54 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:01.219375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0f7d0a0d-1a04-4873-816a-8652d519bc54 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:01.225989 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0f7d0a0d-1a04-4873-816a-8652d519bc54 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:01.226648 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0f7d0a0d-1a04-4873-816a-8652d519bc54 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:01.226960 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0f7d0a0d-1a04-4873-816a-8652d519bc54 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:01.228924 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0f7d0a0d-1a04-4873-816a-8652d519bc54 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:01.229789 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0f7d0a0d-1a04-4873-816a-8652d519bc54 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:01.230108 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0f7d0a0d-1a04-4873-816a-8652d519bc54 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:01.367780 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0f7d0a0d-1a04-4873-816a-8652d519bc54 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:01.380050 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-a29c59be-558a-4186-8c83-5b6b6ecc0c6a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:01.380050 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-a29c59be-558a-4186-8c83-5b6b6ecc0c6a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:01.386066 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0f7d0a0d-1a04-4873-816a-8652d519bc54 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1359 microversion: 2.1 time: 0.171489 Oct 11 12:12:01.389420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a29c59be-558a-4186-8c83-5b6b6ecc0c6a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:01.389788 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a29c59be-558a-4186-8c83-5b6b6ecc0c6a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:01.390102 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a29c59be-558a-4186-8c83-5b6b6ecc0c6a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:01.390965 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a29c59be-558a-4186-8c83-5b6b6ecc0c6a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:01.391751 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a29c59be-558a-4186-8c83-5b6b6ecc0c6a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:01.392325 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a29c59be-558a-4186-8c83-5b6b6ecc0c6a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:01.407756 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 494/944] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:12:01 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:12:01.443948 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-a29c59be-558a-4186-8c83-5b6b6ecc0c6a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.070559 Oct 11 12:12:01.444697 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 451/945] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Oct 11 12:12:01 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:12:01.509883 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-55e4a6a6-fa38-4774-b7a8-2cbb51fd4e88 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:01.510374 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-55e4a6a6-fa38-4774-b7a8-2cbb51fd4e88 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:01.516791 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-55e4a6a6-fa38-4774-b7a8-2cbb51fd4e88 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:01.517271 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-55e4a6a6-fa38-4774-b7a8-2cbb51fd4e88 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:01.518011 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-55e4a6a6-fa38-4774-b7a8-2cbb51fd4e88 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:01.518750 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-55e4a6a6-fa38-4774-b7a8-2cbb51fd4e88 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:01.519207 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-55e4a6a6-fa38-4774-b7a8-2cbb51fd4e88 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:01.519625 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-55e4a6a6-fa38-4774-b7a8-2cbb51fd4e88 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:01.546122 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-55e4a6a6-fa38-4774-b7a8-2cbb51fd4e88 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Going to try to terminate instance {{(pid=118995) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 12:12:01.626957 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-55e4a6a6-fa38-4774-b7a8-2cbb51fd4e88 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 204 len: 0 microversion: 2.20 time: 0.120672 Oct 11 12:12:01.627537 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 495/946] 10.222.0.59 () {60 vars in 1280 bytes} [Tue Oct 11 12:12:01 2022] DELETE /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 11 12:12:01.639067 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-62e1d280-bced-4138-8202-909c9da208ed tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:01.639990 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-62e1d280-bced-4138-8202-909c9da208ed tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:01.649061 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-62e1d280-bced-4138-8202-909c9da208ed tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:01.649764 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-62e1d280-bced-4138-8202-909c9da208ed tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:01.650480 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-62e1d280-bced-4138-8202-909c9da208ed tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:01.651706 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-62e1d280-bced-4138-8202-909c9da208ed tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:01.652152 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-62e1d280-bced-4138-8202-909c9da208ed tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:01.652572 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-62e1d280-bced-4138-8202-909c9da208ed tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:01.783860 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-62e1d280-bced-4138-8202-909c9da208ed tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:01.796193 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-62e1d280-bced-4138-8202-909c9da208ed tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:01.798462 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-62e1d280-bced-4138-8202-909c9da208ed tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:01.800193 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-62e1d280-bced-4138-8202-909c9da208ed tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1725 microversion: 2.20 time: 0.167596 Oct 11 12:12:01.801035 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 452/947] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:12:01 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:12:02.415985 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5f513362-03d8-42d3-beed-4e70f1dd32bb tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:02.416682 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-5f513362-03d8-42d3-beed-4e70f1dd32bb tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:02.423383 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5f513362-03d8-42d3-beed-4e70f1dd32bb tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:02.423829 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5f513362-03d8-42d3-beed-4e70f1dd32bb tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:02.424283 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5f513362-03d8-42d3-beed-4e70f1dd32bb tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:02.425383 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5f513362-03d8-42d3-beed-4e70f1dd32bb tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:02.425383 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5f513362-03d8-42d3-beed-4e70f1dd32bb tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:02.425769 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5f513362-03d8-42d3-beed-4e70f1dd32bb tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:02.562289 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5f513362-03d8-42d3-beed-4e70f1dd32bb tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:02.570486 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5f513362-03d8-42d3-beed-4e70f1dd32bb tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1359 microversion: 2.1 time: 0.158842 Oct 11 12:12:02.571106 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 496/948] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:12:02 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:12:02.828641 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-7b4e2472-dac1-4877-a6f6-dd1fc0573380 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:02.829249 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-7b4e2472-dac1-4877-a6f6-dd1fc0573380 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:02.835976 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7b4e2472-dac1-4877-a6f6-dd1fc0573380 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:02.836457 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7b4e2472-dac1-4877-a6f6-dd1fc0573380 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:02.836916 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7b4e2472-dac1-4877-a6f6-dd1fc0573380 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:02.837600 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7b4e2472-dac1-4877-a6f6-dd1fc0573380 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:02.838038 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7b4e2472-dac1-4877-a6f6-dd1fc0573380 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:02.838509 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7b4e2472-dac1-4877-a6f6-dd1fc0573380 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:02.989669 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-7b4e2472-dac1-4877-a6f6-dd1fc0573380 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:02.999033 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-7b4e2472-dac1-4877-a6f6-dd1fc0573380 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:03.000465 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-7b4e2472-dac1-4877-a6f6-dd1fc0573380 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:03.001633 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-7b4e2472-dac1-4877-a6f6-dd1fc0573380 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1725 microversion: 2.20 time: 0.176953 Oct 11 12:12:03.002206 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 453/949] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:12:02 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:12:03.593772 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-001d52b7-952b-49cc-91da-d97f7ea0dbe4 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:03.594484 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-001d52b7-952b-49cc-91da-d97f7ea0dbe4 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:03.601223 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-001d52b7-952b-49cc-91da-d97f7ea0dbe4 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:03.601702 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-001d52b7-952b-49cc-91da-d97f7ea0dbe4 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:03.602127 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-001d52b7-952b-49cc-91da-d97f7ea0dbe4 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:03.602845 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-001d52b7-952b-49cc-91da-d97f7ea0dbe4 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:03.603295 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-001d52b7-952b-49cc-91da-d97f7ea0dbe4 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:03.603703 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-001d52b7-952b-49cc-91da-d97f7ea0dbe4 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:03.747150 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-001d52b7-952b-49cc-91da-d97f7ea0dbe4 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:03.755057 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-001d52b7-952b-49cc-91da-d97f7ea0dbe4 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1359 microversion: 2.1 time: 0.165142 Oct 11 12:12:03.755709 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 497/950] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:12:03 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:12:04.026951 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-9cdadc6c-fbdd-4ecd-a918-e71a2c466122 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:04.027610 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-9cdadc6c-fbdd-4ecd-a918-e71a2c466122 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:04.034391 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9cdadc6c-fbdd-4ecd-a918-e71a2c466122 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:04.034911 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9cdadc6c-fbdd-4ecd-a918-e71a2c466122 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:04.035335 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9cdadc6c-fbdd-4ecd-a918-e71a2c466122 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:04.036018 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9cdadc6c-fbdd-4ecd-a918-e71a2c466122 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:04.036458 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9cdadc6c-fbdd-4ecd-a918-e71a2c466122 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:04.036957 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9cdadc6c-fbdd-4ecd-a918-e71a2c466122 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:04.170146 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-9cdadc6c-fbdd-4ecd-a918-e71a2c466122 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:04.181870 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-9cdadc6c-fbdd-4ecd-a918-e71a2c466122 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:04.183489 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-9cdadc6c-fbdd-4ecd-a918-e71a2c466122 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:04.184709 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-9cdadc6c-fbdd-4ecd-a918-e71a2c466122 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1725 microversion: 2.20 time: 0.162135 Oct 11 12:12:04.185254 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 454/951] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:12:04 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:12:04.778690 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6443b858-e0bf-40e6-90be-e03714dc2dc3 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:04.779642 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-6443b858-e0bf-40e6-90be-e03714dc2dc3 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:04.786096 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6443b858-e0bf-40e6-90be-e03714dc2dc3 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:04.786585 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6443b858-e0bf-40e6-90be-e03714dc2dc3 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:04.787035 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6443b858-e0bf-40e6-90be-e03714dc2dc3 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:04.787723 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6443b858-e0bf-40e6-90be-e03714dc2dc3 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:04.788174 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6443b858-e0bf-40e6-90be-e03714dc2dc3 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:04.788588 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6443b858-e0bf-40e6-90be-e03714dc2dc3 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:04.946272 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6443b858-e0bf-40e6-90be-e03714dc2dc3 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:04.954528 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6443b858-e0bf-40e6-90be-e03714dc2dc3 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1359 microversion: 2.1 time: 0.179949 Oct 11 12:12:04.962667 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 498/952] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:12:04 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1359 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:12:05.209740 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-59f56888-8a1a-4137-981c-1c585efcd7f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:05.210321 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-59f56888-8a1a-4137-981c-1c585efcd7f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:05.217006 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-59f56888-8a1a-4137-981c-1c585efcd7f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:05.217485 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-59f56888-8a1a-4137-981c-1c585efcd7f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:05.217915 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-59f56888-8a1a-4137-981c-1c585efcd7f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:05.218650 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-59f56888-8a1a-4137-981c-1c585efcd7f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:05.219101 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-59f56888-8a1a-4137-981c-1c585efcd7f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:05.219519 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-59f56888-8a1a-4137-981c-1c585efcd7f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:05.358531 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-59f56888-8a1a-4137-981c-1c585efcd7f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:05.368178 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-59f56888-8a1a-4137-981c-1c585efcd7f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:05.369603 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-59f56888-8a1a-4137-981c-1c585efcd7f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:05.370955 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-59f56888-8a1a-4137-981c-1c585efcd7f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1725 microversion: 2.20 time: 0.165359 Oct 11 12:12:05.371769 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 455/953] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:12:05 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:12:05.977585 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a0de95fa-cc61-45cd-85b7-4e5ee39f66b5 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:05.978213 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a0de95fa-cc61-45cd-85b7-4e5ee39f66b5 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:05.985198 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0de95fa-cc61-45cd-85b7-4e5ee39f66b5 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:05.985694 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0de95fa-cc61-45cd-85b7-4e5ee39f66b5 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:05.986117 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0de95fa-cc61-45cd-85b7-4e5ee39f66b5 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:05.986860 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0de95fa-cc61-45cd-85b7-4e5ee39f66b5 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:05.987314 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0de95fa-cc61-45cd-85b7-4e5ee39f66b5 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:05.987737 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0de95fa-cc61-45cd-85b7-4e5ee39f66b5 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:06.397499 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-6de5858a-ddd0-41bc-bcfa-7ec5490b79a8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:06.399150 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-6de5858a-ddd0-41bc-bcfa-7ec5490b79a8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:06.406683 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6de5858a-ddd0-41bc-bcfa-7ec5490b79a8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:06.407383 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6de5858a-ddd0-41bc-bcfa-7ec5490b79a8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:06.407822 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6de5858a-ddd0-41bc-bcfa-7ec5490b79a8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:06.408565 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6de5858a-ddd0-41bc-bcfa-7ec5490b79a8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:06.409020 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6de5858a-ddd0-41bc-bcfa-7ec5490b79a8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:06.409442 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6de5858a-ddd0-41bc-bcfa-7ec5490b79a8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:06.478399 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a0de95fa-cc61-45cd-85b7-4e5ee39f66b5 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:06.489563 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a0de95fa-cc61-45cd-85b7-4e5ee39f66b5 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1359 microversion: 2.1 time: 0.515768 Oct 11 12:12:06.495155 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 499/954] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:12:05 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1359 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:12:06.501632 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-6de5858a-ddd0-41bc-bcfa-7ec5490b79a8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:06.515267 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-6de5858a-ddd0-41bc-bcfa-7ec5490b79a8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:06.516734 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-6de5858a-ddd0-41bc-bcfa-7ec5490b79a8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:06.518237 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-6de5858a-ddd0-41bc-bcfa-7ec5490b79a8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1657 microversion: 2.20 time: 0.125485 Oct 11 12:12:06.518843 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 456/955] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:12:06 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1657 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 12:12:06.591686 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-adb20661-db02-4e35-99cc-6c664439b070 req-50cebbad-99e7-4f0f-b200-ae7eaf94207f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f1f910a-6135-426a-97a7-570948cf922c", "name": "network-vif-deleted", "tag": "4781df9c-1cb1-4999-a0a2-4e1d4e77d276"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:12:06.600945 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-adb20661-db02-4e35-99cc-6c664439b070 req-50cebbad-99e7-4f0f-b200-ae7eaf94207f service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:06.601419 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-adb20661-db02-4e35-99cc-6c664439b070 req-50cebbad-99e7-4f0f-b200-ae7eaf94207f service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:06.601843 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-adb20661-db02-4e35-99cc-6c664439b070 req-50cebbad-99e7-4f0f-b200-ae7eaf94207f service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:06.613585 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-adb20661-db02-4e35-99cc-6c664439b070 req-50cebbad-99e7-4f0f-b200-ae7eaf94207f service nova] Creating event network-vif-deleted:4781df9c-1cb1-4999-a0a2-4e1d4e77d276 for instance 2f1f910a-6135-426a-97a7-570948cf922c on hv-cinder-82099 Oct 11 12:12:06.618725 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-adb20661-db02-4e35-99cc-6c664439b070 req-50cebbad-99e7-4f0f-b200-ae7eaf94207f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030763 Oct 11 12:12:06.619311 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 500/956] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:12:07.271402 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-c737ed12-4e72-423f-ac2a-8d565cb8b149 req-35edb451-0e3d-4c25-8e01-1a8638c0ac7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fa95338-071a-4ea3-9562-c37c74c182ac", "name": "network-vif-plugged", "status": "completed", "tag": "91b90de7-e871-422f-a2ac-9331cb77b634"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:12:07.281225 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-c737ed12-4e72-423f-ac2a-8d565cb8b149 req-35edb451-0e3d-4c25-8e01-1a8638c0ac7b service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:07.281757 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-c737ed12-4e72-423f-ac2a-8d565cb8b149 req-35edb451-0e3d-4c25-8e01-1a8638c0ac7b service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:07.282254 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-c737ed12-4e72-423f-ac2a-8d565cb8b149 req-35edb451-0e3d-4c25-8e01-1a8638c0ac7b service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:07.301297 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-c737ed12-4e72-423f-ac2a-8d565cb8b149 req-35edb451-0e3d-4c25-8e01-1a8638c0ac7b service nova] Creating event network-vif-plugged:91b90de7-e871-422f-a2ac-9331cb77b634 for instance 2fa95338-071a-4ea3-9562-c37c74c182ac on hv-cinder-82099 Oct 11 12:12:07.306630 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-c737ed12-4e72-423f-ac2a-8d565cb8b149 req-35edb451-0e3d-4c25-8e01-1a8638c0ac7b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163219 Oct 11 12:12:07.307250 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 457/957] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:12:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 12:12:07.512121 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e64e6a7f-085f-4844-a353-29fd68a6a130 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:07.512971 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e64e6a7f-085f-4844-a353-29fd68a6a130 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:07.522368 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e64e6a7f-085f-4844-a353-29fd68a6a130 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:07.523046 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e64e6a7f-085f-4844-a353-29fd68a6a130 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:07.523535 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e64e6a7f-085f-4844-a353-29fd68a6a130 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:07.524590 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e64e6a7f-085f-4844-a353-29fd68a6a130 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:07.525220 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e64e6a7f-085f-4844-a353-29fd68a6a130 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:07.525634 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e64e6a7f-085f-4844-a353-29fd68a6a130 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:07.546575 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-c4c41ebb-8871-47a1-9f30-157605da62a6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:07.547313 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-c4c41ebb-8871-47a1-9f30-157605da62a6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:07.554435 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c4c41ebb-8871-47a1-9f30-157605da62a6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:07.557362 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c4c41ebb-8871-47a1-9f30-157605da62a6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:07.557861 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c4c41ebb-8871-47a1-9f30-157605da62a6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:07.563142 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c4c41ebb-8871-47a1-9f30-157605da62a6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:07.563973 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c4c41ebb-8871-47a1-9f30-157605da62a6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:07.564598 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c4c41ebb-8871-47a1-9f30-157605da62a6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:07.605511 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c4c41ebb-8871-47a1-9f30-157605da62a6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:07.606255 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c4c41ebb-8871-47a1-9f30-157605da62a6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:07.606911 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c4c41ebb-8871-47a1-9f30-157605da62a6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:07.607531 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.objects.instance [None req-c4c41ebb-8871-47a1-9f30-157605da62a6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lazy-loading 'fault' on Instance uuid 2f1f910a-6135-426a-97a7-570948cf922c {{(pid=118994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:12:07.651380 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-c4c41ebb-8871-47a1-9f30-157605da62a6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:07.660581 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-c4c41ebb-8871-47a1-9f30-157605da62a6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:07.662270 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-c4c41ebb-8871-47a1-9f30-157605da62a6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:07.663670 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-c4c41ebb-8871-47a1-9f30-157605da62a6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 200 len: 1372 microversion: 2.20 time: 0.122289 Oct 11 12:12:07.664503 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 458/958] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:12:07 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 1372 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 12:12:07.723534 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e64e6a7f-085f-4844-a353-29fd68a6a130 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:07.731193 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e64e6a7f-085f-4844-a353-29fd68a6a130 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1359 microversion: 2.1 time: 0.223309 Oct 11 12:12:07.731763 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 501/959] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:12:07 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1359 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:12:08.691301 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-879d9027-f0f0-46c0-8226-4659edd1baf9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:08.691948 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-879d9027-f0f0-46c0-8226-4659edd1baf9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:08.699871 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-879d9027-f0f0-46c0-8226-4659edd1baf9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:08.700420 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-879d9027-f0f0-46c0-8226-4659edd1baf9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:08.700914 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-879d9027-f0f0-46c0-8226-4659edd1baf9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:08.701683 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-879d9027-f0f0-46c0-8226-4659edd1baf9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:08.702226 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-879d9027-f0f0-46c0-8226-4659edd1baf9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:08.702714 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-879d9027-f0f0-46c0-8226-4659edd1baf9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:08.717719 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.wsgi [None req-879d9027-f0f0-46c0-8226-4659edd1baf9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] HTTP exception thrown: Instance 2f1f910a-6135-426a-97a7-570948cf922c could not be found. Oct 11 12:12:08.719400 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-879d9027-f0f0-46c0-8226-4659edd1baf9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Request method failure captured: Oct 11 12:12:08.719400 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: request: GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c HTTP/1.1 Oct 11 12:12:08.719400 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept: application/json Oct 11 12:12:08.719400 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept-Encoding: identity Oct 11 12:12:08.719400 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Connection: close Oct 11 12:12:08.719400 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Length: 0 Oct 11 12:12:08.719400 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Type: application/json Oct 11 12:12:08.719400 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Host: 10.222.0.59 Oct 11 12:12:08.719400 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Openstack-System-Scope: None Oct 11 12:12:08.719400 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: User-Agent: python-urllib3/1.26.12 Oct 11 12:12:08.719400 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Auth-Token: gAAAAABjRVyOMBKd26owVfU6SSh2w6xAae8qJvUd5mAUTdnNIRwDSx6TAHiasVGas-qC_lxwzPP8nnCxoANLf3SBvIOQlovMeFH1EzwPme9zR6R7OLSyQ-XNd81RFR2CJ0GQsyD5kN1UAPTybpLXawK3rq_7dBEKv7_dBCuh3bN3b4428vp4NbQ Oct 11 12:12:08.719400 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Id: None Oct 11 12:12:08.719400 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Name: None Oct 11 12:12:08.719400 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Identity-Status: Confirmed Oct 11 12:12:08.719400 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Is-Admin-Project: True Oct 11 12:12:08.719400 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 12:12:08.719400 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Id: default Oct 11 12:12:08.719400 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Name: Default Oct 11 12:12:08.719400 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Id: fee1ecae514e4c79a4f0fe601391971d Oct 11 12:12:08.719400 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-857450641 Oct 11 12:12:08.719400 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Role: reader,member Oct 11 12:12:08.719400 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Roles: reader,member Oct 11 12:12:08.721121 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/fee1ecae514e4c79a4f0fe601391971d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_fee1ecae514e4c79a4f0fe601391971d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fee1ecae514e4c79a4f0fe601391971d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fee1ecae514e4c79a4f0fe601391971d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:12:08.721121 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant: tempest-AttachVolumeShelveTestJSON-857450641 Oct 11 12:12:08.721121 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Id: fee1ecae514e4c79a4f0fe601391971d Oct 11 12:12:08.721121 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-857450641 Oct 11 12:12:08.721121 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User: tempest-AttachVolumeShelveTestJSON-857450641-project Oct 11 12:12:08.721121 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Id: default Oct 11 12:12:08.721121 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Name: Default Oct 11 12:12:08.721121 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Id: abfa19ab0a624de6ab082e8b1e57a220 Oct 11 12:12:08.721121 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Name: tempest-AttachVolumeShelveTestJSON-857450641-project Oct 11 12:12:08.721121 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: method: > Oct 11 12:12:08.721121 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: exception: Instance 2f1f910a-6135-426a-97a7-570948cf922c could not be found. Oct 11 12:12:08.721121 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: action_args: {'id': '2f1f910a-6135-426a-97a7-570948cf922c'} Oct 11 12:12:08.722089 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:12:08.722089 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:12:08.722089 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:12:08.722089 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:12:08.722089 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:12:08.722089 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:12:08.722089 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:12:08.722089 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:12:08.722089 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:12:08.722089 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:12:08.722089 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f1f910a-6135-426a-97a7-570948cf922c could not be found. Oct 11 12:12:08.722089 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:12:08.722089 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:12:08.722089 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:12:08.722089 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:12:08.722089 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:12:08.722089 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:12:08.722089 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:12:08.722089 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:12:08.722089 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:12:08.723698 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:12:08.723698 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 12:12:08.723698 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 12:12:08.723698 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:12:08.723698 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:12:08.723698 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:12:08.723698 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:12:08.723698 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f1f910a-6135-426a-97a7-570948cf922c could not be found. Oct 11 12:12:08.723698 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:12:08.723698 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:12:08.723698 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:12:08.723698 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:12:08.723698 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:12:08.723698 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:12:08.723698 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:12:08.723698 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:12:08.723698 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f1f910a-6135-426a-97a7-570948cf922c could not be found. Oct 11 12:12:08.723698 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:12:08.725124 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-879d9027-f0f0-46c0-8226-4659edd1baf9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Returning 404 to user: Instance 2f1f910a-6135-426a-97a7-570948cf922c could not be found. {{(pid=118994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:12:08.725124 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-879d9027-f0f0-46c0-8226-4659edd1baf9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 404 len: 111 microversion: 2.20 time: 0.034043 Oct 11 12:12:08.725124 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 459/960] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:12:08 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 12:12:08.730004 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7095207c-a364-4b19-bb90-4f6d3b8ad860 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '.version_select at 0x7fd40663bb80>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:08.758587 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-48629671-7c91-40d9-ab36-4658ec72e71a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:08.760178 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7095207c-a364-4b19-bb90-4f6d3b8ad860 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1876244646" status: 204 len: 0 microversion: 2.20 time: 0.034075 Oct 11 12:12:08.760829 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 502/961] 10.222.0.59 () {60 vars in 1262 bytes} [Tue Oct 11 12:12:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1876244646 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 12:12:08.761487 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-48629671-7c91-40d9-ab36-4658ec72e71a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:08.768353 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-48629671-7c91-40d9-ab36-4658ec72e71a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:08.768843 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-48629671-7c91-40d9-ab36-4658ec72e71a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:08.769300 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-48629671-7c91-40d9-ab36-4658ec72e71a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:08.770002 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-48629671-7c91-40d9-ab36-4658ec72e71a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:08.770487 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-48629671-7c91-40d9-ab36-4658ec72e71a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:08.770932 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-48629671-7c91-40d9-ab36-4658ec72e71a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:08.906517 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-48629671-7c91-40d9-ab36-4658ec72e71a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:08.915436 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-48629671-7c91-40d9-ab36-4658ec72e71a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1359 microversion: 2.1 time: 0.162569 Oct 11 12:12:08.926582 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 460/962] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:12:08 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:12:09.443395 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-1c9b8e38-76bc-45ba-8121-721fc818c992 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Action: 'create', calling method: .version_select at 0x7fd406744280>, body: {"keypair": {"name": "tempest-keypair-707816474", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKZuhii/QCaD4/VeNyWF8eqIKWqxP2sVVN+2GKT0vLdJI4039F7Z6NYBu1rPXQySGOIaWFk8NbTmP2pW3Nsu2pi2dP3fLd6W6FAgXCHbWGVN3shxNIWUwiaiBF30JokmIw=="}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:12:09.448700 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=1,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:12:09.462222 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-1c9b8e38-76bc-45ba-8121-721fc818c992 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Getting quotas for project fee1ecae514e4c79a4f0fe601391971d. Resources: {'key_pairs'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 12:12:09.466500 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-1c9b8e38-76bc-45ba-8121-721fc818c992 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Getting quotas for user abfa19ab0a624de6ab082e8b1e57a220 and project fee1ecae514e4c79a4f0fe601391971d. Resources: {'key_pairs'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 12:12:09.490457 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-1c9b8e38-76bc-45ba-8121-721fc818c992 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.051043 Oct 11 12:12:09.491099 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 503/963] 10.222.0.59 () {62 vars in 1200 bytes} [Tue Oct 11 12:12:09 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 52 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 11 12:12:09.939903 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-79505c94-e358-45fd-a6fe-40940673de50 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:09.940556 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-79505c94-e358-45fd-a6fe-40940673de50 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:09.943078 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:12:09.950131 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-79505c94-e358-45fd-a6fe-40940673de50 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:09.950652 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-79505c94-e358-45fd-a6fe-40940673de50 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:09.951291 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-79505c94-e358-45fd-a6fe-40940673de50 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:09.951984 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-79505c94-e358-45fd-a6fe-40940673de50 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:09.952613 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-79505c94-e358-45fd-a6fe-40940673de50 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:09.953036 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-79505c94-e358-45fd-a6fe-40940673de50 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:10.110875 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-79505c94-e358-45fd-a6fe-40940673de50 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:10.119053 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-79505c94-e358-45fd-a6fe-40940673de50 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1549 microversion: 2.1 time: 0.183117 Oct 11 12:12:10.119634 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 461/964] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:12:09 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1549 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:12:10.144547 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0a3d0b71-83f0-4f00-a4bc-d4b0057ccfe7 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:10.145310 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0a3d0b71-83f0-4f00-a4bc-d4b0057ccfe7 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:10.152581 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0a3d0b71-83f0-4f00-a4bc-d4b0057ccfe7 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:10.153162 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0a3d0b71-83f0-4f00-a4bc-d4b0057ccfe7 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:10.153666 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0a3d0b71-83f0-4f00-a4bc-d4b0057ccfe7 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:10.154381 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0a3d0b71-83f0-4f00-a4bc-d4b0057ccfe7 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:10.154879 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0a3d0b71-83f0-4f00-a4bc-d4b0057ccfe7 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:10.155303 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0a3d0b71-83f0-4f00-a4bc-d4b0057ccfe7 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:10.481737 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0a3d0b71-83f0-4f00-a4bc-d4b0057ccfe7 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:10.505688 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0a3d0b71-83f0-4f00-a4bc-d4b0057ccfe7 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1549 microversion: 2.1 time: 0.366589 Oct 11 12:12:10.506801 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 504/965] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:12:10 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1549 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:12:10.528710 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-8f5bfe2e-e162-4783-8138-cbe4f8e0d010 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:10.533643 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-8f5bfe2e-e162-4783-8138-cbe4f8e0d010 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:10.534452 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-8f5bfe2e-e162-4783-8138-cbe4f8e0d010 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Searching by: {'deleted': False, 'project_id': 'f48db192fac04a06932590c23b751595'} {{(pid=118994) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 12:12:10.542037 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8f5bfe2e-e162-4783-8138-cbe4f8e0d010 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:10.542516 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8f5bfe2e-e162-4783-8138-cbe4f8e0d010 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:10.543001 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8f5bfe2e-e162-4783-8138-cbe4f8e0d010 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:10.543715 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8f5bfe2e-e162-4783-8138-cbe4f8e0d010 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:10.544164 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8f5bfe2e-e162-4783-8138-cbe4f8e0d010 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:10.544578 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8f5bfe2e-e162-4783-8138-cbe4f8e0d010 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:10.645228 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.multi_cell_list [None req-8f5bfe2e-e162-4783-8138-cbe4f8e0d010 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118994) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 12:12:10.904922 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-8f5bfe2e-e162-4783-8138-cbe4f8e0d010 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.380159 Oct 11 12:12:10.905508 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 462/966] 10.222.0.59 () {58 vars in 1125 bytes} [Tue Oct 11 12:12:10 2022] GET /compute/v2.1/servers => generated 343 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:12:10.917198 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2c46561c-06a7-420f-883d-3eb8d9c6c33f tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:10.917803 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2c46561c-06a7-420f-883d-3eb8d9c6c33f tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:10.923955 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2c46561c-06a7-420f-883d-3eb8d9c6c33f tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:10.924413 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2c46561c-06a7-420f-883d-3eb8d9c6c33f tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:10.925037 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2c46561c-06a7-420f-883d-3eb8d9c6c33f tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:10.925739 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2c46561c-06a7-420f-883d-3eb8d9c6c33f tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:10.926181 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2c46561c-06a7-420f-883d-3eb8d9c6c33f tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:10.926598 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2c46561c-06a7-420f-883d-3eb8d9c6c33f tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:11.180539 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2c46561c-06a7-420f-883d-3eb8d9c6c33f tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:11.199419 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2c46561c-06a7-420f-883d-3eb8d9c6c33f tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1549 microversion: 2.1 time: 0.285912 Oct 11 12:12:11.199871 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 505/967] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:12:10 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1549 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:12:11.304417 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-b5919af1-d58a-45f6-bd3c-778a7cb0f9a3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-473864129", "imageRef": "09bcc8f8-a32f-4ec8-9ab2-a98964ad6a01", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed154ac0-1001-49f4-9212-ccb30c198992"}], "security_groups": [{"name": "tempest-securitygroup--1875382259"}], "key_name": "tempest-keypair-707816474", "user_data": "}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:12:11.416366 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.network.neutron [None req-b5919af1-d58a-45f6-bd3c-778a7cb0f9a3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] validate_networks() for [('ed154ac0-1001-49f4-9212-ccb30c198992', None, None, None, None, None)] {{(pid=118994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 12:12:11.820868 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-b5919af1-d58a-45f6-bd3c-778a7cb0f9a3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Flavor limits 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 12:12:11.821285 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-b5919af1-d58a-45f6-bd3c-778a7cb0f9a3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Image limits 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 12:12:11.821750 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-b5919af1-d58a-45f6-bd3c-778a7cb0f9a3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Flavor pref 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 12:12:11.822135 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-b5919af1-d58a-45f6-bd3c-778a7cb0f9a3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Image pref 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 12:12:11.822546 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-b5919af1-d58a-45f6-bd3c-778a7cb0f9a3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 12:12:11.832341 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b5919af1-d58a-45f6-bd3c-778a7cb0f9a3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:11.832828 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b5919af1-d58a-45f6-bd3c-778a7cb0f9a3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:11.833256 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b5919af1-d58a-45f6-bd3c-778a7cb0f9a3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:11.833972 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b5919af1-d58a-45f6-bd3c-778a7cb0f9a3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:11.834413 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b5919af1-d58a-45f6-bd3c-778a7cb0f9a3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:11.834871 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-b5919af1-d58a-45f6-bd3c-778a7cb0f9a3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:11.852251 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-b5919af1-d58a-45f6-bd3c-778a7cb0f9a3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Getting quotas for project fee1ecae514e4c79a4f0fe601391971d. Resources: {'ram', 'instances', 'cores'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 12:12:11.856663 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-b5919af1-d58a-45f6-bd3c-778a7cb0f9a3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Getting quotas for user abfa19ab0a624de6ab082e8b1e57a220 and project fee1ecae514e4c79a4f0fe601391971d. Resources: {'ram', 'instances', 'cores'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 12:12:11.868991 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-b5919af1-d58a-45f6-bd3c-778a7cb0f9a3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Going to run 1 instances... {{(pid=118994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 12:12:11.871362 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-b5919af1-d58a-45f6-bd3c-778a7cb0f9a3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='09bcc8f8-a32f-4ec8-9ab2-a98964ad6a01',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 12:12:11.920530 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-b5919af1-d58a-45f6-bd3c-778a7cb0f9a3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.620414 Oct 11 12:12:11.927493 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 463/968] 10.222.0.59 () {62 vars in 1188 bytes} [Tue Oct 11 12:12:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 12:12:11.932873 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e4580dcf-d749-4601-b223-a2bdc8be14b3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:11.933530 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e4580dcf-d749-4601-b223-a2bdc8be14b3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:11.989782 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e4580dcf-d749-4601-b223-a2bdc8be14b3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:11.998889 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e4580dcf-d749-4601-b223-a2bdc8be14b3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:12.000217 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-e4580dcf-d749-4601-b223-a2bdc8be14b3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:12.001313 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e4580dcf-d749-4601-b223-a2bdc8be14b3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1280 microversion: 2.20 time: 0.072729 Oct 11 12:12:12.001916 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 506/969] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:12:11 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1280 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 12:12:12.871262 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-ed033bc2-3dbb-4089-aaf9-941bbbc82f5c tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7aa99961-c1de-4c52-b629-0fb5efd1f448"}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:12:12.873786 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-ed033bc2-3dbb-4089-aaf9-941bbbc82f5c tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:12.880840 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ed033bc2-3dbb-4089-aaf9-941bbbc82f5c tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:12.881318 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ed033bc2-3dbb-4089-aaf9-941bbbc82f5c tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:12.881745 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ed033bc2-3dbb-4089-aaf9-941bbbc82f5c tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:12.882436 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ed033bc2-3dbb-4089-aaf9-941bbbc82f5c tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:12.882896 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ed033bc2-3dbb-4089-aaf9-941bbbc82f5c tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:12.883350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ed033bc2-3dbb-4089-aaf9-941bbbc82f5c tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:13.025467 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c7e171b2-56b6-4945-b7fa-e6f026fa702f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:13.026091 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c7e171b2-56b6-4945-b7fa-e6f026fa702f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:13.033130 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c7e171b2-56b6-4945-b7fa-e6f026fa702f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:13.033607 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c7e171b2-56b6-4945-b7fa-e6f026fa702f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:13.034033 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c7e171b2-56b6-4945-b7fa-e6f026fa702f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:13.034761 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c7e171b2-56b6-4945-b7fa-e6f026fa702f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:13.035201 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c7e171b2-56b6-4945-b7fa-e6f026fa702f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:13.035614 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c7e171b2-56b6-4945-b7fa-e6f026fa702f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:13.104750 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c7e171b2-56b6-4945-b7fa-e6f026fa702f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:13.113192 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c7e171b2-56b6-4945-b7fa-e6f026fa702f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:13.114689 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c7e171b2-56b6-4945-b7fa-e6f026fa702f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:13.115798 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c7e171b2-56b6-4945-b7fa-e6f026fa702f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1332 microversion: 2.20 time: 0.094354 Oct 11 12:12:13.116352 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 507/970] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:12:13 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1332 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 12:12:13.304569 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-ed033bc2-3dbb-4089-aaf9-941bbbc82f5c tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "POST /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.439491 Oct 11 12:12:13.305946 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 464/971] 10.222.0.59 () {60 vars in 1323 bytes} [Tue Oct 11 12:12:12 2022] POST /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac/os-volume_attachments => generated 194 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:12:14.143443 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d9752b39-382c-4fc5-82cd-9d71ae4c45a4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:14.144223 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d9752b39-382c-4fc5-82cd-9d71ae4c45a4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:14.155380 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d9752b39-382c-4fc5-82cd-9d71ae4c45a4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:14.155891 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d9752b39-382c-4fc5-82cd-9d71ae4c45a4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:14.156343 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d9752b39-382c-4fc5-82cd-9d71ae4c45a4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:14.157035 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d9752b39-382c-4fc5-82cd-9d71ae4c45a4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:14.157485 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d9752b39-382c-4fc5-82cd-9d71ae4c45a4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:14.157905 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d9752b39-382c-4fc5-82cd-9d71ae4c45a4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:14.367486 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d9752b39-382c-4fc5-82cd-9d71ae4c45a4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:14.376152 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d9752b39-382c-4fc5-82cd-9d71ae4c45a4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:14.377607 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d9752b39-382c-4fc5-82cd-9d71ae4c45a4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:14.378816 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d9752b39-382c-4fc5-82cd-9d71ae4c45a4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1406 microversion: 2.20 time: 0.241002 Oct 11 12:12:14.379538 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 508/972] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:12:14 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1406 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:12:14.976081 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-b1c6d898-ae6a-4c48-9879-99c07a107ba9 req-72b59444-6788-4c6f-a27a-40b730ecabc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f7ef566-fc3f-4b87-96a7-2d2a650a4d15", "tag": "587860e6-e550-42be-bb20-fe198f47ec93"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:12:14.988673 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-b1c6d898-ae6a-4c48-9879-99c07a107ba9 req-72b59444-6788-4c6f-a27a-40b730ecabc0 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:14.989317 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-b1c6d898-ae6a-4c48-9879-99c07a107ba9 req-72b59444-6788-4c6f-a27a-40b730ecabc0 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:14.990091 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-b1c6d898-ae6a-4c48-9879-99c07a107ba9 req-72b59444-6788-4c6f-a27a-40b730ecabc0 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:15.005154 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-b1c6d898-ae6a-4c48-9879-99c07a107ba9 req-72b59444-6788-4c6f-a27a-40b730ecabc0 service nova] Creating event network-changed:587860e6-e550-42be-bb20-fe198f47ec93 for instance 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 on hv-cinder-82099 Oct 11 12:12:15.010704 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-b1c6d898-ae6a-4c48-9879-99c07a107ba9 req-72b59444-6788-4c6f-a27a-40b730ecabc0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039109 Oct 11 12:12:15.011428 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 465/973] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:12:15.404085 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2b2e6256-ac1c-45cb-9d8c-afb17670862d tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:15.404713 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2b2e6256-ac1c-45cb-9d8c-afb17670862d tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:15.411606 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2b2e6256-ac1c-45cb-9d8c-afb17670862d tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:15.412081 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2b2e6256-ac1c-45cb-9d8c-afb17670862d tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:15.412510 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2b2e6256-ac1c-45cb-9d8c-afb17670862d tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:15.413201 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2b2e6256-ac1c-45cb-9d8c-afb17670862d tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:15.413617 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2b2e6256-ac1c-45cb-9d8c-afb17670862d tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:15.414030 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2b2e6256-ac1c-45cb-9d8c-afb17670862d tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:15.563280 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2b2e6256-ac1c-45cb-9d8c-afb17670862d tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:15.571952 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2b2e6256-ac1c-45cb-9d8c-afb17670862d tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:15.573503 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2b2e6256-ac1c-45cb-9d8c-afb17670862d tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:15.574653 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2b2e6256-ac1c-45cb-9d8c-afb17670862d tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1406 microversion: 2.20 time: 0.174605 Oct 11 12:12:15.575208 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 509/974] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:12:15 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:12:16.601766 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-61948ac2-aed0-4425-b3a1-a3f8f5e71212 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:16.602459 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-61948ac2-aed0-4425-b3a1-a3f8f5e71212 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:16.611214 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-61948ac2-aed0-4425-b3a1-a3f8f5e71212 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:16.611780 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-61948ac2-aed0-4425-b3a1-a3f8f5e71212 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:16.612290 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-61948ac2-aed0-4425-b3a1-a3f8f5e71212 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:16.613106 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-61948ac2-aed0-4425-b3a1-a3f8f5e71212 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:16.613645 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-61948ac2-aed0-4425-b3a1-a3f8f5e71212 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:16.614120 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-61948ac2-aed0-4425-b3a1-a3f8f5e71212 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:16.619502 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:12:16.758435 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-61948ac2-aed0-4425-b3a1-a3f8f5e71212 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:16.767689 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-61948ac2-aed0-4425-b3a1-a3f8f5e71212 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:16.769524 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-61948ac2-aed0-4425-b3a1-a3f8f5e71212 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:16.770675 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-61948ac2-aed0-4425-b3a1-a3f8f5e71212 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1406 microversion: 2.20 time: 0.174462 Oct 11 12:12:16.771231 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 466/975] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:12:16 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1406 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:12:17.797094 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0d2d24df-68a5-4d28-95d1-91f28f7733f1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:17.797693 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0d2d24df-68a5-4d28-95d1-91f28f7733f1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:17.804391 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0d2d24df-68a5-4d28-95d1-91f28f7733f1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:17.804863 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0d2d24df-68a5-4d28-95d1-91f28f7733f1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:17.805285 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0d2d24df-68a5-4d28-95d1-91f28f7733f1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:17.805961 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0d2d24df-68a5-4d28-95d1-91f28f7733f1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:17.806399 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0d2d24df-68a5-4d28-95d1-91f28f7733f1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:17.806849 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0d2d24df-68a5-4d28-95d1-91f28f7733f1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:17.953227 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0d2d24df-68a5-4d28-95d1-91f28f7733f1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:17.961739 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0d2d24df-68a5-4d28-95d1-91f28f7733f1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:17.963195 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0d2d24df-68a5-4d28-95d1-91f28f7733f1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:17.964743 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0d2d24df-68a5-4d28-95d1-91f28f7733f1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1406 microversion: 2.20 time: 0.171239 Oct 11 12:12:17.965810 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 510/976] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:12:17 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:12:18.990239 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-beaf6ffe-ef5a-4d6c-916d-be0e344be47f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:18.990863 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-beaf6ffe-ef5a-4d6c-916d-be0e344be47f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:18.998182 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-beaf6ffe-ef5a-4d6c-916d-be0e344be47f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:18.998684 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-beaf6ffe-ef5a-4d6c-916d-be0e344be47f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:18.999112 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-beaf6ffe-ef5a-4d6c-916d-be0e344be47f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:18.999808 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-beaf6ffe-ef5a-4d6c-916d-be0e344be47f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:19.000247 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-beaf6ffe-ef5a-4d6c-916d-be0e344be47f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:19.000662 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-beaf6ffe-ef5a-4d6c-916d-be0e344be47f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:19.141363 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-beaf6ffe-ef5a-4d6c-916d-be0e344be47f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:19.150267 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-beaf6ffe-ef5a-4d6c-916d-be0e344be47f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:19.151731 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-beaf6ffe-ef5a-4d6c-916d-be0e344be47f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:19.152975 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-beaf6ffe-ef5a-4d6c-916d-be0e344be47f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1406 microversion: 2.20 time: 0.167063 Oct 11 12:12:19.153546 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 467/977] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:12:18 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:12:20.177870 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a175ad06-c45c-47a9-b8ef-2a2319f1c0e2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:20.178630 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a175ad06-c45c-47a9-b8ef-2a2319f1c0e2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:20.185083 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a175ad06-c45c-47a9-b8ef-2a2319f1c0e2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:20.185557 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a175ad06-c45c-47a9-b8ef-2a2319f1c0e2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:20.185984 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a175ad06-c45c-47a9-b8ef-2a2319f1c0e2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:20.186697 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a175ad06-c45c-47a9-b8ef-2a2319f1c0e2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:20.187143 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a175ad06-c45c-47a9-b8ef-2a2319f1c0e2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:20.187572 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a175ad06-c45c-47a9-b8ef-2a2319f1c0e2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:20.327344 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a175ad06-c45c-47a9-b8ef-2a2319f1c0e2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:20.335728 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a175ad06-c45c-47a9-b8ef-2a2319f1c0e2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:20.337139 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a175ad06-c45c-47a9-b8ef-2a2319f1c0e2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:20.338285 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a175ad06-c45c-47a9-b8ef-2a2319f1c0e2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1406 microversion: 2.20 time: 0.164548 Oct 11 12:12:20.338865 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 511/978] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:12:20 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:12:20.951776 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-2ef1dee0-14ca-4b5e-814c-21f532ad701e tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:20.952377 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-2ef1dee0-14ca-4b5e-814c-21f532ad701e tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:20.958912 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2ef1dee0-14ca-4b5e-814c-21f532ad701e tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:20.959664 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2ef1dee0-14ca-4b5e-814c-21f532ad701e tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:20.960290 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2ef1dee0-14ca-4b5e-814c-21f532ad701e tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:20.961175 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2ef1dee0-14ca-4b5e-814c-21f532ad701e tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:20.961918 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2ef1dee0-14ca-4b5e-814c-21f532ad701e tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:20.962834 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2ef1dee0-14ca-4b5e-814c-21f532ad701e tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:21.107262 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-2ef1dee0-14ca-4b5e-814c-21f532ad701e tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:21.115624 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-2ef1dee0-14ca-4b5e-814c-21f532ad701e tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1595 microversion: 2.1 time: 0.167852 Oct 11 12:12:21.116217 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 468/979] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:12:20 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1595 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:12:21.363514 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-76d9204c-daa1-42c9-bf8a-7d5956cb3855 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:21.364159 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-76d9204c-daa1-42c9-bf8a-7d5956cb3855 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:21.371710 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-76d9204c-daa1-42c9-bf8a-7d5956cb3855 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:21.372193 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-76d9204c-daa1-42c9-bf8a-7d5956cb3855 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:21.372620 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-76d9204c-daa1-42c9-bf8a-7d5956cb3855 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:21.373477 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-76d9204c-daa1-42c9-bf8a-7d5956cb3855 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:21.373755 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-76d9204c-daa1-42c9-bf8a-7d5956cb3855 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:21.374152 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-76d9204c-daa1-42c9-bf8a-7d5956cb3855 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:21.389436 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:12:21.511547 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-76d9204c-daa1-42c9-bf8a-7d5956cb3855 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:21.523960 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-76d9204c-daa1-42c9-bf8a-7d5956cb3855 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:21.526783 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-76d9204c-daa1-42c9-bf8a-7d5956cb3855 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:21.528997 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-76d9204c-daa1-42c9-bf8a-7d5956cb3855 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1406 microversion: 2.20 time: 0.169403 Oct 11 12:12:21.530205 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 512/980] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:12:21 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:12:22.555411 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-e790efab-c38a-4ec0-b739-0ef651e4bca9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:22.556063 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-e790efab-c38a-4ec0-b739-0ef651e4bca9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:22.558143 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell0:SELECT=4 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:12:22.558902 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell0:SELECT=6 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:12:22.566139 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e790efab-c38a-4ec0-b739-0ef651e4bca9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:22.566686 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e790efab-c38a-4ec0-b739-0ef651e4bca9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:22.567139 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e790efab-c38a-4ec0-b739-0ef651e4bca9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:22.567862 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e790efab-c38a-4ec0-b739-0ef651e4bca9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:22.568355 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e790efab-c38a-4ec0-b739-0ef651e4bca9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:22.568776 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e790efab-c38a-4ec0-b739-0ef651e4bca9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:22.974747 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-e790efab-c38a-4ec0-b739-0ef651e4bca9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:22.984177 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-e790efab-c38a-4ec0-b739-0ef651e4bca9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:22.985529 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-e790efab-c38a-4ec0-b739-0ef651e4bca9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:22.986858 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-e790efab-c38a-4ec0-b739-0ef651e4bca9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1406 microversion: 2.20 time: 0.435899 Oct 11 12:12:22.991561 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 469/981] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:12:22 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1406 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:12:23.009683 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-7b66b0bc-69e1-4884-8421-014ca2442983 req-ea83ac0a-bd1d-49f4-8264-b9f279ff133d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f7ef566-fc3f-4b87-96a7-2d2a650a4d15", "name": "network-vif-plugged", "status": "completed", "tag": "587860e6-e550-42be-bb20-fe198f47ec93"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:12:23.016159 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=6 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:12:23.022584 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-7b66b0bc-69e1-4884-8421-014ca2442983 req-ea83ac0a-bd1d-49f4-8264-b9f279ff133d service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:23.023085 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-7b66b0bc-69e1-4884-8421-014ca2442983 req-ea83ac0a-bd1d-49f4-8264-b9f279ff133d service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:23.025545 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-7b66b0bc-69e1-4884-8421-014ca2442983 req-ea83ac0a-bd1d-49f4-8264-b9f279ff133d service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:23.035225 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-7b66b0bc-69e1-4884-8421-014ca2442983 req-ea83ac0a-bd1d-49f4-8264-b9f279ff133d service nova] Creating event network-vif-plugged:587860e6-e550-42be-bb20-fe198f47ec93 for instance 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 on hv-cinder-82099 Oct 11 12:12:23.044340 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-7b66b0bc-69e1-4884-8421-014ca2442983 req-ea83ac0a-bd1d-49f4-8264-b9f279ff133d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038609 Oct 11 12:12:23.044945 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 513/982] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 12:12:23.279406 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-303cecde-f7db-406a-bfa7-fa7bda97a863 req-d1a5c4b2-b197-44f4-8482-a29360520861 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fa95338-071a-4ea3-9562-c37c74c182ac", "tag": "91b90de7-e871-422f-a2ac-9331cb77b634"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:12:23.290403 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-303cecde-f7db-406a-bfa7-fa7bda97a863 req-d1a5c4b2-b197-44f4-8482-a29360520861 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:23.291173 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-303cecde-f7db-406a-bfa7-fa7bda97a863 req-d1a5c4b2-b197-44f4-8482-a29360520861 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:23.291790 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-303cecde-f7db-406a-bfa7-fa7bda97a863 req-d1a5c4b2-b197-44f4-8482-a29360520861 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:23.305125 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-303cecde-f7db-406a-bfa7-fa7bda97a863 req-d1a5c4b2-b197-44f4-8482-a29360520861 service nova] Creating event network-changed:91b90de7-e871-422f-a2ac-9331cb77b634 for instance 2fa95338-071a-4ea3-9562-c37c74c182ac on hv-cinder-82099 Oct 11 12:12:23.312083 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-303cecde-f7db-406a-bfa7-fa7bda97a863 req-d1a5c4b2-b197-44f4-8482-a29360520861 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036087 Oct 11 12:12:23.312865 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 470/983] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 12:12:24.013619 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-519fd6d8-50c3-4011-bd63-2201f9667af7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:24.014331 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-519fd6d8-50c3-4011-bd63-2201f9667af7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:24.022834 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-519fd6d8-50c3-4011-bd63-2201f9667af7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:24.023412 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-519fd6d8-50c3-4011-bd63-2201f9667af7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:24.023776 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-519fd6d8-50c3-4011-bd63-2201f9667af7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:24.024570 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-519fd6d8-50c3-4011-bd63-2201f9667af7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:24.025100 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-519fd6d8-50c3-4011-bd63-2201f9667af7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:24.025570 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-519fd6d8-50c3-4011-bd63-2201f9667af7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:24.184937 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-519fd6d8-50c3-4011-bd63-2201f9667af7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:24.200688 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-519fd6d8-50c3-4011-bd63-2201f9667af7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:24.202129 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-519fd6d8-50c3-4011-bd63-2201f9667af7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:24.203718 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-519fd6d8-50c3-4011-bd63-2201f9667af7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1406 microversion: 2.20 time: 0.194354 Oct 11 12:12:24.204123 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 514/984] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:12:24 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1406 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:12:24.354891 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-ece9e0ac-29ad-4fef-bb7c-f8ac5e4e489a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1242537367"}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:12:24.356150 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-ece9e0ac-29ad-4fef-bb7c-f8ac5e4e489a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:24.363258 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ece9e0ac-29ad-4fef-bb7c-f8ac5e4e489a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:24.363696 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ece9e0ac-29ad-4fef-bb7c-f8ac5e4e489a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:24.364172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ece9e0ac-29ad-4fef-bb7c-f8ac5e4e489a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:24.364868 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ece9e0ac-29ad-4fef-bb7c-f8ac5e4e489a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:24.365320 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ece9e0ac-29ad-4fef-bb7c-f8ac5e4e489a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:24.365744 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ece9e0ac-29ad-4fef-bb7c-f8ac5e4e489a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:24.503927 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.network.security_group_api [None req-ece9e0ac-29ad-4fef-bb7c-f8ac5e4e489a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Adding security group 2964b4e6-ffd1-4ec9-aa2a-ffa0d39072da to port 91b90de7-e871-422f-a2ac-9331cb77b634 Oct 11 12:12:24.861810 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-ece9e0ac-29ad-4fef-bb7c-f8ac5e4e489a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "POST /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac/action" status: 202 len: 0 microversion: 2.1 time: 0.511785 Oct 11 12:12:24.871368 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-d2c86a42-1295-45c6-89bd-bf4564c0fda8 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:24.871974 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-d2c86a42-1295-45c6-89bd-bf4564c0fda8 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:24.877406 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 471/985] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Oct 11 12:12:24 2022] POST /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac/action => generated 0 bytes in 528 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 12:12:24.880843 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d2c86a42-1295-45c6-89bd-bf4564c0fda8 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:24.881339 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d2c86a42-1295-45c6-89bd-bf4564c0fda8 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:24.881765 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d2c86a42-1295-45c6-89bd-bf4564c0fda8 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:24.882461 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d2c86a42-1295-45c6-89bd-bf4564c0fda8 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:24.882937 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d2c86a42-1295-45c6-89bd-bf4564c0fda8 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:24.883540 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-d2c86a42-1295-45c6-89bd-bf4564c0fda8 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:25.231839 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-26875de0-ff76-4955-be7d-7b499a41e8e6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:25.233246 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-26875de0-ff76-4955-be7d-7b499a41e8e6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:25.240292 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-26875de0-ff76-4955-be7d-7b499a41e8e6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:25.241060 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-26875de0-ff76-4955-be7d-7b499a41e8e6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:25.241690 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-26875de0-ff76-4955-be7d-7b499a41e8e6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:25.242384 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-26875de0-ff76-4955-be7d-7b499a41e8e6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:25.242889 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-26875de0-ff76-4955-be7d-7b499a41e8e6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:25.243316 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-26875de0-ff76-4955-be7d-7b499a41e8e6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:25.352422 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-d2c86a42-1295-45c6-89bd-bf4564c0fda8 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:25.363079 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-d2c86a42-1295-45c6-89bd-bf4564c0fda8 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1642 microversion: 2.1 time: 0.495471 Oct 11 12:12:25.364895 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 515/986] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:12:24 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1642 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:12:25.370059 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-0c1aff16-8686-4e1f-a158-27892c6fb599 req-671f74ad-c98d-4695-8f0c-8f124c3b28e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fa95338-071a-4ea3-9562-c37c74c182ac", "tag": "91b90de7-e871-422f-a2ac-9331cb77b634"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:12:25.389896 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-0c1aff16-8686-4e1f-a158-27892c6fb599 req-671f74ad-c98d-4695-8f0c-8f124c3b28e8 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:25.390767 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-0c1aff16-8686-4e1f-a158-27892c6fb599 req-671f74ad-c98d-4695-8f0c-8f124c3b28e8 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:25.391193 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-0c1aff16-8686-4e1f-a158-27892c6fb599 req-671f74ad-c98d-4695-8f0c-8f124c3b28e8 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:25.402289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-26875de0-ff76-4955-be7d-7b499a41e8e6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:25.404147 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-0c1aff16-8686-4e1f-a158-27892c6fb599 req-671f74ad-c98d-4695-8f0c-8f124c3b28e8 service nova] Creating event network-changed:91b90de7-e871-422f-a2ac-9331cb77b634 for instance 2fa95338-071a-4ea3-9562-c37c74c182ac on hv-cinder-82099 Oct 11 12:12:25.411879 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-0c1aff16-8686-4e1f-a158-27892c6fb599 req-671f74ad-c98d-4695-8f0c-8f124c3b28e8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045421 Oct 11 12:12:25.412459 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-26875de0-ff76-4955-be7d-7b499a41e8e6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:25.413358 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 516/987] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:12:25.414018 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-26875de0-ff76-4955-be7d-7b499a41e8e6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:25.415180 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-26875de0-ff76-4955-be7d-7b499a41e8e6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1406 microversion: 2.20 time: 0.187926 Oct 11 12:12:25.416048 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 472/988] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:12:25 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1406 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 12:12:26.443297 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-cca2a988-067a-4833-9dfb-44b215ccfa3d tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:26.443986 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-cca2a988-067a-4833-9dfb-44b215ccfa3d tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:26.451081 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cca2a988-067a-4833-9dfb-44b215ccfa3d tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:26.451555 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cca2a988-067a-4833-9dfb-44b215ccfa3d tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:26.452016 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cca2a988-067a-4833-9dfb-44b215ccfa3d tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:26.453573 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cca2a988-067a-4833-9dfb-44b215ccfa3d tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:26.454375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cca2a988-067a-4833-9dfb-44b215ccfa3d tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:26.454850 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cca2a988-067a-4833-9dfb-44b215ccfa3d tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:26.597786 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-cca2a988-067a-4833-9dfb-44b215ccfa3d tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:26.605899 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-cca2a988-067a-4833-9dfb-44b215ccfa3d tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:26.607357 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-cca2a988-067a-4833-9dfb-44b215ccfa3d tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:12:26.608507 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-cca2a988-067a-4833-9dfb-44b215ccfa3d tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1599 microversion: 2.20 time: 0.170052 Oct 11 12:12:26.609061 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 517/989] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:12:26 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1599 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:12:26.632748 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-8d72a819-f965-4293-9fee-a31cd1ce8c83 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:12:26.633320 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-8d72a819-f965-4293-9fee-a31cd1ce8c83 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:12:26.640332 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8d72a819-f965-4293-9fee-a31cd1ce8c83 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:26.640809 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8d72a819-f965-4293-9fee-a31cd1ce8c83 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:26.641246 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8d72a819-f965-4293-9fee-a31cd1ce8c83 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:26.641934 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8d72a819-f965-4293-9fee-a31cd1ce8c83 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:26.642384 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8d72a819-f965-4293-9fee-a31cd1ce8c83 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:26.642842 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-8d72a819-f965-4293-9fee-a31cd1ce8c83 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:26.731741 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-8d72a819-f965-4293-9fee-a31cd1ce8c83 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.102312 Oct 11 12:12:26.732335 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 473/990] 10.222.0.59 () {60 vars in 1316 bytes} [Tue Oct 11 12:12:26 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15/os-interface => generated 285 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 12:12:27.709124 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-3350dc95-b2e7-40cc-8350-d21140bd3f1a req-b7a68de0-66fc-4122-9eaa-22cd238fc48a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f7ef566-fc3f-4b87-96a7-2d2a650a4d15", "tag": "587860e6-e550-42be-bb20-fe198f47ec93"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:12:27.720522 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-3350dc95-b2e7-40cc-8350-d21140bd3f1a req-b7a68de0-66fc-4122-9eaa-22cd238fc48a service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:12:27.720988 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-3350dc95-b2e7-40cc-8350-d21140bd3f1a req-b7a68de0-66fc-4122-9eaa-22cd238fc48a service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:12:27.721431 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-3350dc95-b2e7-40cc-8350-d21140bd3f1a req-b7a68de0-66fc-4122-9eaa-22cd238fc48a service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:12:27.732637 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-3350dc95-b2e7-40cc-8350-d21140bd3f1a req-b7a68de0-66fc-4122-9eaa-22cd238fc48a service nova] Creating event network-changed:587860e6-e550-42be-bb20-fe198f47ec93 for instance 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 on hv-cinder-82099 Oct 11 12:12:27.737855 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-3350dc95-b2e7-40cc-8350-d21140bd3f1a req-b7a68de0-66fc-4122-9eaa-22cd238fc48a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033286 Oct 11 12:12:27.738442 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 518/991] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:12:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:12:55.044001 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:12:55.044967 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=38 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:12:55.296327 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-aeae8c5a-373c-4318-8c7e-854bea83b377 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Action: 'create', calling method: .version_select at 0x7fd4066810d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-79745519", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKkaVV2O7wFcEPCcWe3jvB3O6pl7HFpTZ/GWbh6+qemkhia4mo1+iIsPB5r3/4UsvrdfOX0UuoFk0WHMZ5McQADH1YAgdm++MWNWKpbs2a5smdE1LYZzvR7l2CeTorFTFA=="}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:12:55.313960 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-aeae8c5a-373c-4318-8c7e-854bea83b377 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Getting quotas for project 4f2eaa1959394ae3a4b4b27d00b917d1. Resources: {'key_pairs'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 12:12:55.318542 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-aeae8c5a-373c-4318-8c7e-854bea83b377 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Getting quotas for user 82c54e3aa3aa46a28373acb91f32cc9a and project 4f2eaa1959394ae3a4b4b27d00b917d1. Resources: {'key_pairs'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 12:12:55.350472 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-aeae8c5a-373c-4318-8c7e-854bea83b377 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.308078 Oct 11 12:12:55.351764 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 474/992] 10.222.0.59 () {60 vars in 1159 bytes} [Tue Oct 11 12:12:55 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:13:04.547257 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-7c09a9b3-48b1-4bc0-97f1-b8707077d66a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:04.548025 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7c09a9b3-48b1-4bc0-97f1-b8707077d66a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:04.552666 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:13:04.559262 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=27 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:13:04.569479 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c09a9b3-48b1-4bc0-97f1-b8707077d66a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:04.570048 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c09a9b3-48b1-4bc0-97f1-b8707077d66a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:04.570473 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c09a9b3-48b1-4bc0-97f1-b8707077d66a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:04.571530 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c09a9b3-48b1-4bc0-97f1-b8707077d66a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:04.571990 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c09a9b3-48b1-4bc0-97f1-b8707077d66a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:04.572529 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-7c09a9b3-48b1-4bc0-97f1-b8707077d66a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:04.603996 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-7c09a9b3-48b1-4bc0-97f1-b8707077d66a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Going to try to terminate instance {{(pid=118995) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 12:13:04.608254 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-8cb0b7fe-9142-457f-9c95-6d14a3f4c17c req-1a9c952a-99af-41a1-85a6-3a1df7c5d030 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ddb150d-886c-46f4-9c3d-0722148d7d91", "tag": "473109ef-4d1a-4e60-84ad-152e53b93a74"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:13:04.619169 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-8cb0b7fe-9142-457f-9c95-6d14a3f4c17c req-1a9c952a-99af-41a1-85a6-3a1df7c5d030 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:04.619642 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-8cb0b7fe-9142-457f-9c95-6d14a3f4c17c req-1a9c952a-99af-41a1-85a6-3a1df7c5d030 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:04.620241 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-8cb0b7fe-9142-457f-9c95-6d14a3f4c17c req-1a9c952a-99af-41a1-85a6-3a1df7c5d030 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:04.631348 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-8cb0b7fe-9142-457f-9c95-6d14a3f4c17c req-1a9c952a-99af-41a1-85a6-3a1df7c5d030 service nova] Creating event network-changed:473109ef-4d1a-4e60-84ad-152e53b93a74 for instance 5ddb150d-886c-46f4-9c3d-0722148d7d91 on hv-cinder-82099 Oct 11 12:13:04.637216 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-8cb0b7fe-9142-457f-9c95-6d14a3f4c17c req-1a9c952a-99af-41a1-85a6-3a1df7c5d030 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092041 Oct 11 12:13:04.638200 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 475/993] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 12:13:04.697200 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-7c09a9b3-48b1-4bc0-97f1-b8707077d66a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 204 len: 0 microversion: 2.1 time: 0.154122 Oct 11 12:13:04.698059 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 519/994] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Oct 11 12:13:04 2022] DELETE /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 12:13:04.708435 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-6b094c8d-0ec9-442c-a198-45f7be100d8a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:04.709517 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-6b094c8d-0ec9-442c-a198-45f7be100d8a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:04.716779 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6b094c8d-0ec9-442c-a198-45f7be100d8a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:04.717413 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6b094c8d-0ec9-442c-a198-45f7be100d8a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:04.717944 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6b094c8d-0ec9-442c-a198-45f7be100d8a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:04.718799 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6b094c8d-0ec9-442c-a198-45f7be100d8a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:04.719389 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6b094c8d-0ec9-442c-a198-45f7be100d8a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:04.719983 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6b094c8d-0ec9-442c-a198-45f7be100d8a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:04.868852 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-6b094c8d-0ec9-442c-a198-45f7be100d8a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:04.876926 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-6b094c8d-0ec9-442c-a198-45f7be100d8a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1568 microversion: 2.1 time: 0.172836 Oct 11 12:13:04.877590 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 476/995] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:13:04 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1568 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:13:05.901899 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-161b0a19-3b59-4d16-8d2a-b9215fafa6cc tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:05.902529 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-161b0a19-3b59-4d16-8d2a-b9215fafa6cc tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:05.909632 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-161b0a19-3b59-4d16-8d2a-b9215fafa6cc tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:05.910115 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-161b0a19-3b59-4d16-8d2a-b9215fafa6cc tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:05.910549 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-161b0a19-3b59-4d16-8d2a-b9215fafa6cc tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:05.911266 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-161b0a19-3b59-4d16-8d2a-b9215fafa6cc tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:05.911710 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-161b0a19-3b59-4d16-8d2a-b9215fafa6cc tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:05.912129 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-161b0a19-3b59-4d16-8d2a-b9215fafa6cc tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:06.127487 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-161b0a19-3b59-4d16-8d2a-b9215fafa6cc tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:06.137780 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-161b0a19-3b59-4d16-8d2a-b9215fafa6cc tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1568 microversion: 2.1 time: 0.240458 Oct 11 12:13:06.138367 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 520/996] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:13:05 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1568 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:13:07.163144 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-a2c1d386-152e-4c6e-9d87-b0abddb637ca tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:07.163932 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-a2c1d386-152e-4c6e-9d87-b0abddb637ca tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:07.166471 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell0:SELECT=4 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:13:07.173322 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a2c1d386-152e-4c6e-9d87-b0abddb637ca tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:07.173797 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a2c1d386-152e-4c6e-9d87-b0abddb637ca tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:07.174222 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a2c1d386-152e-4c6e-9d87-b0abddb637ca tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:07.174947 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a2c1d386-152e-4c6e-9d87-b0abddb637ca tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:07.175388 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a2c1d386-152e-4c6e-9d87-b0abddb637ca tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:07.175828 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a2c1d386-152e-4c6e-9d87-b0abddb637ca tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:07.329155 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-a2c1d386-152e-4c6e-9d87-b0abddb637ca tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:07.337404 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-a2c1d386-152e-4c6e-9d87-b0abddb637ca tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1568 microversion: 2.1 time: 0.178230 Oct 11 12:13:07.350054 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 477/997] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:13:07 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1568 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:13:07.765573 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-fee39d70-9738-4fb8-add3-c4abbe6e44d6 req-83bfe806-2704-4f9c-808a-90360f8a27d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ddb150d-886c-46f4-9c3d-0722148d7d91", "name": "network-vif-deleted", "tag": "473109ef-4d1a-4e60-84ad-152e53b93a74"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:13:07.777684 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-fee39d70-9738-4fb8-add3-c4abbe6e44d6 req-83bfe806-2704-4f9c-808a-90360f8a27d1 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:07.778150 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-fee39d70-9738-4fb8-add3-c4abbe6e44d6 req-83bfe806-2704-4f9c-808a-90360f8a27d1 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:07.778580 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-fee39d70-9738-4fb8-add3-c4abbe6e44d6 req-83bfe806-2704-4f9c-808a-90360f8a27d1 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:07.791211 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-fee39d70-9738-4fb8-add3-c4abbe6e44d6 req-83bfe806-2704-4f9c-808a-90360f8a27d1 service nova] Creating event network-vif-deleted:473109ef-4d1a-4e60-84ad-152e53b93a74 for instance 5ddb150d-886c-46f4-9c3d-0722148d7d91 on hv-cinder-82099 Oct 11 12:13:07.797018 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-fee39d70-9738-4fb8-add3-c4abbe6e44d6 req-83bfe806-2704-4f9c-808a-90360f8a27d1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035259 Oct 11 12:13:07.797627 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 521/998] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:13:08.363594 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-0cb75bfb-8b95-4d1b-9a7a-26f0c91f1d8a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:08.364468 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-0cb75bfb-8b95-4d1b-9a7a-26f0c91f1d8a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:08.371187 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0cb75bfb-8b95-4d1b-9a7a-26f0c91f1d8a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:08.371675 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0cb75bfb-8b95-4d1b-9a7a-26f0c91f1d8a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:08.372109 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0cb75bfb-8b95-4d1b-9a7a-26f0c91f1d8a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:08.372867 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0cb75bfb-8b95-4d1b-9a7a-26f0c91f1d8a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:08.373332 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0cb75bfb-8b95-4d1b-9a7a-26f0c91f1d8a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:08.373764 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0cb75bfb-8b95-4d1b-9a7a-26f0c91f1d8a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:08.443159 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-0cb75bfb-8b95-4d1b-9a7a-26f0c91f1d8a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'edb722b67a804915bf38f34b67845bc9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef7f8c1858da4f73925e63ea06100eab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:08.451245 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-0cb75bfb-8b95-4d1b-9a7a-26f0c91f1d8a tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 200 len: 1220 microversion: 2.1 time: 0.093700 Oct 11 12:13:08.451907 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 478/999] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:13:08 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 1220 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:13:09.479574 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-4d87e4c8-61ce-4426-a382-30a9fc7a0694 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:09.480549 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-4d87e4c8-61ce-4426-a382-30a9fc7a0694 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] [instance: 5ddb150d-886c-46f4-9c3d-0722148d7d91] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:09.488896 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4d87e4c8-61ce-4426-a382-30a9fc7a0694 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:09.489383 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4d87e4c8-61ce-4426-a382-30a9fc7a0694 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:09.489833 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4d87e4c8-61ce-4426-a382-30a9fc7a0694 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:09.490594 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4d87e4c8-61ce-4426-a382-30a9fc7a0694 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:09.491054 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4d87e4c8-61ce-4426-a382-30a9fc7a0694 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:09.491465 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4d87e4c8-61ce-4426-a382-30a9fc7a0694 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:09.505254 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-4d87e4c8-61ce-4426-a382-30a9fc7a0694 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] HTTP exception thrown: Instance 5ddb150d-886c-46f4-9c3d-0722148d7d91 could not be found. Oct 11 12:13:09.506970 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-4d87e4c8-61ce-4426-a382-30a9fc7a0694 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Request method failure captured: Oct 11 12:13:09.506970 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 HTTP/1.1 Oct 11 12:13:09.506970 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 11 12:13:09.506970 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 11 12:13:09.506970 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Connection: close Oct 11 12:13:09.506970 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 11 12:13:09.506970 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 11 12:13:09.506970 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Host: 10.222.0.59 Oct 11 12:13:09.506970 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 11 12:13:09.506970 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 11 12:13:09.506970 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjRVxoPn1KYIq89KUcr2Z9nGQsM2KGSJRH42J_M4hVoFVAIJO5rOrGt050k9EMg4aff5mU4lP4CFd-gh_NpRB0uMnXjZWVK3kfMoMghj-eD7U6EC-BeOuPwa4-yAdHfSBWMzjkPZwwBKNOiObekBXU2GoojIhSefA_oKRDVAe6iZVH5-g Oct 11 12:13:09.506970 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 11 12:13:09.506970 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 11 12:13:09.506970 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 11 12:13:09.506970 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 11 12:13:09.506970 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 11 12:13:09.506970 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 11 12:13:09.506970 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Id: ef7f8c1858da4f73925e63ea06100eab Oct 11 12:13:09.506970 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-TestShelveInstance-2084992060 Oct 11 12:13:09.506970 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Role: reader,member Oct 11 12:13:09.506970 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Roles: reader,member Oct 11 12:13:09.508567 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/ef7f8c1858da4f73925e63ea06100eab"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_ef7f8c1858da4f73925e63ea06100eab"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ef7f8c1858da4f73925e63ea06100eab"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/ef7f8c1858da4f73925e63ea06100eab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:13:09.508567 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-TestShelveInstance-2084992060 Oct 11 12:13:09.508567 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Id: ef7f8c1858da4f73925e63ea06100eab Oct 11 12:13:09.508567 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-TestShelveInstance-2084992060 Oct 11 12:13:09.508567 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User: tempest-TestShelveInstance-2084992060-project Oct 11 12:13:09.508567 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 11 12:13:09.508567 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 11 12:13:09.508567 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Id: edb722b67a804915bf38f34b67845bc9 Oct 11 12:13:09.508567 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-TestShelveInstance-2084992060-project Oct 11 12:13:09.508567 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: method: > Oct 11 12:13:09.508567 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: exception: Instance 5ddb150d-886c-46f4-9c3d-0722148d7d91 could not be found. Oct 11 12:13:09.508567 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: action_args: {'id': '5ddb150d-886c-46f4-9c3d-0722148d7d91'} Oct 11 12:13:09.509451 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:13:09.509451 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:13:09.509451 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:13:09.509451 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:13:09.509451 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:13:09.509451 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:13:09.509451 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:13:09.509451 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:13:09.509451 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:13:09.509451 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:13:09.509451 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ddb150d-886c-46f4-9c3d-0722148d7d91 could not be found. Oct 11 12:13:09.509451 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:13:09.509451 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:13:09.509451 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:13:09.509451 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:13:09.509451 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:13:09.509451 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:13:09.509451 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:13:09.509451 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:13:09.509451 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:13:09.510841 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:13:09.510841 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 12:13:09.510841 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 12:13:09.510841 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:13:09.510841 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:13:09.510841 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:13:09.510841 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:13:09.510841 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ddb150d-886c-46f4-9c3d-0722148d7d91 could not be found. Oct 11 12:13:09.510841 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:13:09.510841 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:13:09.510841 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:13:09.510841 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:13:09.510841 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:13:09.510841 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:13:09.510841 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:13:09.510841 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:13:09.510841 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ddb150d-886c-46f4-9c3d-0722148d7d91 could not be found. Oct 11 12:13:09.510841 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:13:09.512013 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-4d87e4c8-61ce-4426-a382-30a9fc7a0694 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Returning 404 to user: Instance 5ddb150d-886c-46f4-9c3d-0722148d7d91 could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:13:09.512013 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-4d87e4c8-61ce-4426-a382-30a9fc7a0694 tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91" status: 404 len: 111 microversion: 2.1 time: 0.035191 Oct 11 12:13:09.512013 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 522/1000] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:13:09 2022] GET /compute/v2.1/servers/5ddb150d-886c-46f4-9c3d-0722148d7d91 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:13:09.681983 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-8aeb8ff2-2c5f-43bf-936e-7ebcba978e0c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] Calling method '.version_select at 0x7fd4065c8700>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:09.704005 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-8aeb8ff2-2c5f-43bf-936e-7ebcba978e0c tempest-TestShelveInstance-2084992060 tempest-TestShelveInstance-2084992060-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1438686999" status: 202 len: 0 microversion: 2.1 time: 0.025998 Oct 11 12:13:09.704600 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 479/1001] 10.222.0.59 () {58 vars in 1254 bytes} [Tue Oct 11 12:13:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1438686999 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 12:13:21.412242 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-148f9d8d-b3b5-4ee7-8763-2582950404aa tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1724868095", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-79745519", "security_groups": [{"name": "tempest-secgroup-smoke-1304625771"}], "block_device_mapping_v2": [{"uuid": "1b302021-0674-4463-94be-cc56a25169ed", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "86bc98a2-e857-47e1-8cc0-6c28f4d3763e"}]}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:13:21.425851 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 12:13:21.426033 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Tue Oct 11 12:13:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.59) !!! Oct 11 12:13:21.427301 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:13:21.427960 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:13:21.536700 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.network.neutron [None req-148f9d8d-b3b5-4ee7-8763-2582950404aa tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] validate_networks() for [('86bc98a2-e857-47e1-8cc0-6c28f4d3763e', None, None, None, None, None)] {{(pid=118995) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 12:13:22.030974 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-148f9d8d-b3b5-4ee7-8763-2582950404aa tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Flavor limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 12:13:22.031383 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-148f9d8d-b3b5-4ee7-8763-2582950404aa tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Image limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 12:13:22.031844 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-148f9d8d-b3b5-4ee7-8763-2582950404aa tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Flavor pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 12:13:22.032240 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-148f9d8d-b3b5-4ee7-8763-2582950404aa tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Image pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 12:13:22.032661 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-148f9d8d-b3b5-4ee7-8763-2582950404aa tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 12:13:22.041580 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-148f9d8d-b3b5-4ee7-8763-2582950404aa tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:22.042055 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-148f9d8d-b3b5-4ee7-8763-2582950404aa tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:22.042512 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-148f9d8d-b3b5-4ee7-8763-2582950404aa tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:22.043241 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-148f9d8d-b3b5-4ee7-8763-2582950404aa tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:22.043685 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-148f9d8d-b3b5-4ee7-8763-2582950404aa tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:22.044113 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-148f9d8d-b3b5-4ee7-8763-2582950404aa tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:22.060449 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-148f9d8d-b3b5-4ee7-8763-2582950404aa tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Getting quotas for project 4f2eaa1959394ae3a4b4b27d00b917d1. Resources: {'ram', 'instances', 'cores'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 12:13:22.064594 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-148f9d8d-b3b5-4ee7-8763-2582950404aa tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Getting quotas for user 82c54e3aa3aa46a28373acb91f32cc9a and project 4f2eaa1959394ae3a4b4b27d00b917d1. Resources: {'ram', 'instances', 'cores'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 12:13:22.123282 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-148f9d8d-b3b5-4ee7-8763-2582950404aa tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Going to run 1 instances... {{(pid=118995) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 12:13:22.125486 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-148f9d8d-b3b5-4ee7-8763-2582950404aa tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 2f69fb21-4f8a-43d4-a5b9-fb52bab23576] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1b302021-0674-4463-94be-cc56a25169ed',volume_size=None,volume_type=None)] {{(pid=118995) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 12:13:22.258939 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-148f9d8d-b3b5-4ee7-8763-2582950404aa tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.853131 Oct 11 12:13:22.259580 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 523/1002] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Oct 11 12:13:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 12:13:22.268543 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=20 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:13:22.270078 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:13:22.275143 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-9f962cb6-61f2-4627-867f-75238e44495e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:22.275926 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-9f962cb6-61f2-4627-867f-75238e44495e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 2f69fb21-4f8a-43d4-a5b9-fb52bab23576] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:22.334368 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-9f962cb6-61f2-4627-867f-75238e44495e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:22.341277 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-9f962cb6-61f2-4627-867f-75238e44495e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576" status: 200 len: 1093 microversion: 2.1 time: 0.074356 Oct 11 12:13:22.342415 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 480/1003] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:13:22 2022] GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576 => generated 1093 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:13:23.365204 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-974d4d5b-e6e0-48dc-9b1b-f9efdd5fcceb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:23.366441 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-974d4d5b-e6e0-48dc-9b1b-f9efdd5fcceb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 2f69fb21-4f8a-43d4-a5b9-fb52bab23576] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:23.373496 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-974d4d5b-e6e0-48dc-9b1b-f9efdd5fcceb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:23.373995 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-974d4d5b-e6e0-48dc-9b1b-f9efdd5fcceb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:23.374593 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-974d4d5b-e6e0-48dc-9b1b-f9efdd5fcceb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:23.375174 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-974d4d5b-e6e0-48dc-9b1b-f9efdd5fcceb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:23.375623 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-974d4d5b-e6e0-48dc-9b1b-f9efdd5fcceb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:23.376033 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-974d4d5b-e6e0-48dc-9b1b-f9efdd5fcceb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:23.442992 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-974d4d5b-e6e0-48dc-9b1b-f9efdd5fcceb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:23.450925 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-974d4d5b-e6e0-48dc-9b1b-f9efdd5fcceb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576" status: 200 len: 1191 microversion: 2.1 time: 0.089875 Oct 11 12:13:23.451626 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 524/1004] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:13:23 2022] GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576 => generated 1191 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:13:24.479149 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-fd1dec85-8b26-41a2-ae87-cc80899d119d tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:24.479901 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-fd1dec85-8b26-41a2-ae87-cc80899d119d tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 2f69fb21-4f8a-43d4-a5b9-fb52bab23576] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:24.489201 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-fd1dec85-8b26-41a2-ae87-cc80899d119d tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:24.489492 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-fd1dec85-8b26-41a2-ae87-cc80899d119d tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:24.492856 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-fd1dec85-8b26-41a2-ae87-cc80899d119d tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:24.493115 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-fd1dec85-8b26-41a2-ae87-cc80899d119d tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:24.493575 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-fd1dec85-8b26-41a2-ae87-cc80899d119d tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:24.494000 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-fd1dec85-8b26-41a2-ae87-cc80899d119d tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:24.647869 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-fd1dec85-8b26-41a2-ae87-cc80899d119d tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:24.656226 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-fd1dec85-8b26-41a2-ae87-cc80899d119d tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576" status: 200 len: 1277 microversion: 2.1 time: 0.181284 Oct 11 12:13:24.657129 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 481/1005] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:13:24 2022] GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576 => generated 1277 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:13:25.228414 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-df30f146-3406-4021-bdf0-ce19101f63f4 req-0dccaa66-7785-47ae-91c6-913e4d2bf35b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f69fb21-4f8a-43d4-a5b9-fb52bab23576", "tag": "561b9fa3-a590-499e-8240-53039a11fd5f"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:13:25.239265 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-df30f146-3406-4021-bdf0-ce19101f63f4 req-0dccaa66-7785-47ae-91c6-913e4d2bf35b service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:25.240066 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-df30f146-3406-4021-bdf0-ce19101f63f4 req-0dccaa66-7785-47ae-91c6-913e4d2bf35b service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:25.240651 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-df30f146-3406-4021-bdf0-ce19101f63f4 req-0dccaa66-7785-47ae-91c6-913e4d2bf35b service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:25.255204 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-df30f146-3406-4021-bdf0-ce19101f63f4 req-0dccaa66-7785-47ae-91c6-913e4d2bf35b service nova] Creating event network-changed:561b9fa3-a590-499e-8240-53039a11fd5f for instance 2f69fb21-4f8a-43d4-a5b9-fb52bab23576 on hv-cinder-82099 Oct 11 12:13:25.260130 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-df30f146-3406-4021-bdf0-ce19101f63f4 req-0dccaa66-7785-47ae-91c6-913e4d2bf35b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035658 Oct 11 12:13:25.260901 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 525/1006] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 12:13:25.681890 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-fd5f88d9-483f-4543-af15-f6e1b88de184 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:25.682720 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-fd5f88d9-483f-4543-af15-f6e1b88de184 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 2f69fb21-4f8a-43d4-a5b9-fb52bab23576] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:25.691635 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-fd5f88d9-483f-4543-af15-f6e1b88de184 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:25.692113 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-fd5f88d9-483f-4543-af15-f6e1b88de184 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:25.692734 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-fd5f88d9-483f-4543-af15-f6e1b88de184 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:25.693425 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-fd5f88d9-483f-4543-af15-f6e1b88de184 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:25.693865 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-fd5f88d9-483f-4543-af15-f6e1b88de184 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:25.694284 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-fd5f88d9-483f-4543-af15-f6e1b88de184 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:25.835559 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-fd5f88d9-483f-4543-af15-f6e1b88de184 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:25.843401 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-fd5f88d9-483f-4543-af15-f6e1b88de184 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576" status: 200 len: 1265 microversion: 2.1 time: 0.166811 Oct 11 12:13:25.843970 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 482/1007] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:13:25 2022] GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:13:26.877894 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-915a41be-51db-4456-8b59-658de9475d8b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:26.878580 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-915a41be-51db-4456-8b59-658de9475d8b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 2f69fb21-4f8a-43d4-a5b9-fb52bab23576] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:26.885036 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-915a41be-51db-4456-8b59-658de9475d8b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:26.885522 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-915a41be-51db-4456-8b59-658de9475d8b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:26.885952 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-915a41be-51db-4456-8b59-658de9475d8b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:26.886661 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-915a41be-51db-4456-8b59-658de9475d8b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:26.887138 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-915a41be-51db-4456-8b59-658de9475d8b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:26.887557 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-915a41be-51db-4456-8b59-658de9475d8b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:27.092379 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-915a41be-51db-4456-8b59-658de9475d8b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:27.101796 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-915a41be-51db-4456-8b59-658de9475d8b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576" status: 200 len: 1265 microversion: 2.1 time: 0.228551 Oct 11 12:13:27.102672 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 526/1008] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:13:26 2022] GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576 => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:13:28.132596 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-fdaf80f5-408f-4aca-b115-4f96d826866b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:28.133179 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-fdaf80f5-408f-4aca-b115-4f96d826866b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 2f69fb21-4f8a-43d4-a5b9-fb52bab23576] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:28.140189 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-fdaf80f5-408f-4aca-b115-4f96d826866b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:28.140679 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-fdaf80f5-408f-4aca-b115-4f96d826866b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:28.141183 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-fdaf80f5-408f-4aca-b115-4f96d826866b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:28.141939 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-fdaf80f5-408f-4aca-b115-4f96d826866b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:28.142390 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-fdaf80f5-408f-4aca-b115-4f96d826866b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:28.142963 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-fdaf80f5-408f-4aca-b115-4f96d826866b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:28.279304 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-fdaf80f5-408f-4aca-b115-4f96d826866b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:28.287216 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-fdaf80f5-408f-4aca-b115-4f96d826866b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576" status: 200 len: 1265 microversion: 2.1 time: 0.158722 Oct 11 12:13:28.287792 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 483/1009] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:13:28 2022] GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:13:29.313158 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2187ade2-202a-4c5e-955c-0a7fd92be911 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:29.313773 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2187ade2-202a-4c5e-955c-0a7fd92be911 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 2f69fb21-4f8a-43d4-a5b9-fb52bab23576] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:29.320614 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2187ade2-202a-4c5e-955c-0a7fd92be911 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:29.321097 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2187ade2-202a-4c5e-955c-0a7fd92be911 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:29.321527 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2187ade2-202a-4c5e-955c-0a7fd92be911 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:29.322214 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2187ade2-202a-4c5e-955c-0a7fd92be911 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:29.322789 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2187ade2-202a-4c5e-955c-0a7fd92be911 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:29.323206 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2187ade2-202a-4c5e-955c-0a7fd92be911 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:29.469755 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2187ade2-202a-4c5e-955c-0a7fd92be911 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:29.477928 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2187ade2-202a-4c5e-955c-0a7fd92be911 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576" status: 200 len: 1265 microversion: 2.1 time: 0.170772 Oct 11 12:13:29.478500 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 527/1010] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:13:29 2022] GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:13:30.501049 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-0cee06a8-1092-483d-a4db-235f02294af1 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:30.501661 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-0cee06a8-1092-483d-a4db-235f02294af1 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 2f69fb21-4f8a-43d4-a5b9-fb52bab23576] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:30.508579 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0cee06a8-1092-483d-a4db-235f02294af1 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:30.509061 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0cee06a8-1092-483d-a4db-235f02294af1 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:30.509495 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0cee06a8-1092-483d-a4db-235f02294af1 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:30.510191 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0cee06a8-1092-483d-a4db-235f02294af1 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:30.510677 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0cee06a8-1092-483d-a4db-235f02294af1 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:30.511101 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0cee06a8-1092-483d-a4db-235f02294af1 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:30.645979 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-0cee06a8-1092-483d-a4db-235f02294af1 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:30.654143 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-0cee06a8-1092-483d-a4db-235f02294af1 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576" status: 200 len: 1265 microversion: 2.1 time: 0.157092 Oct 11 12:13:30.654789 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 484/1011] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:13:30 2022] GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:13:31.678347 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-40468c0f-1a41-44b2-b93f-bb2539b01d4e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:31.679019 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-40468c0f-1a41-44b2-b93f-bb2539b01d4e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 2f69fb21-4f8a-43d4-a5b9-fb52bab23576] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:31.686185 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-40468c0f-1a41-44b2-b93f-bb2539b01d4e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:31.686752 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-40468c0f-1a41-44b2-b93f-bb2539b01d4e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:31.687183 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-40468c0f-1a41-44b2-b93f-bb2539b01d4e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:31.688013 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-40468c0f-1a41-44b2-b93f-bb2539b01d4e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:31.688466 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-40468c0f-1a41-44b2-b93f-bb2539b01d4e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:31.688944 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-40468c0f-1a41-44b2-b93f-bb2539b01d4e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:31.844235 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-40468c0f-1a41-44b2-b93f-bb2539b01d4e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:31.852177 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-40468c0f-1a41-44b2-b93f-bb2539b01d4e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576" status: 200 len: 1265 microversion: 2.1 time: 0.178367 Oct 11 12:13:31.852739 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 528/1012] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:13:31 2022] GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:13:32.875826 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-3800addf-e712-45f3-a3f1-e3b1a4b9a63c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:32.876622 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-3800addf-e712-45f3-a3f1-e3b1a4b9a63c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 2f69fb21-4f8a-43d4-a5b9-fb52bab23576] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:32.879557 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell0:SELECT=2 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:13:32.887388 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3800addf-e712-45f3-a3f1-e3b1a4b9a63c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:32.888017 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3800addf-e712-45f3-a3f1-e3b1a4b9a63c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:32.888598 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3800addf-e712-45f3-a3f1-e3b1a4b9a63c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:32.889653 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3800addf-e712-45f3-a3f1-e3b1a4b9a63c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:32.890244 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3800addf-e712-45f3-a3f1-e3b1a4b9a63c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:32.890783 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3800addf-e712-45f3-a3f1-e3b1a4b9a63c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:33.043085 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-3800addf-e712-45f3-a3f1-e3b1a4b9a63c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:33.051868 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-3800addf-e712-45f3-a3f1-e3b1a4b9a63c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576" status: 200 len: 1265 microversion: 2.1 time: 0.180390 Oct 11 12:13:33.052452 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 485/1013] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:13:32 2022] GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:13:34.077744 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-db2f492a-4a04-4578-8db9-374b92cf8c39 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:34.078631 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-db2f492a-4a04-4578-8db9-374b92cf8c39 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 2f69fb21-4f8a-43d4-a5b9-fb52bab23576] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:34.081676 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=2 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:13:34.082650 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=6 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:13:34.092147 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-db2f492a-4a04-4578-8db9-374b92cf8c39 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:34.092874 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-db2f492a-4a04-4578-8db9-374b92cf8c39 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:34.093510 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-db2f492a-4a04-4578-8db9-374b92cf8c39 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:34.094340 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-db2f492a-4a04-4578-8db9-374b92cf8c39 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:34.094824 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-db2f492a-4a04-4578-8db9-374b92cf8c39 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:34.095238 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-db2f492a-4a04-4578-8db9-374b92cf8c39 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:34.240574 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-db2f492a-4a04-4578-8db9-374b92cf8c39 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:34.252200 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-db2f492a-4a04-4578-8db9-374b92cf8c39 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576" status: 200 len: 1265 microversion: 2.1 time: 0.180282 Oct 11 12:13:34.252871 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 529/1014] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:13:34 2022] GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:13:35.276427 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-5c630e07-f9d1-4115-a2e6-5d9683570e1c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:35.277053 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-5c630e07-f9d1-4115-a2e6-5d9683570e1c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 2f69fb21-4f8a-43d4-a5b9-fb52bab23576] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:35.283848 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5c630e07-f9d1-4115-a2e6-5d9683570e1c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:35.284359 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5c630e07-f9d1-4115-a2e6-5d9683570e1c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:35.284772 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5c630e07-f9d1-4115-a2e6-5d9683570e1c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:35.285458 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5c630e07-f9d1-4115-a2e6-5d9683570e1c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:35.285922 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5c630e07-f9d1-4115-a2e6-5d9683570e1c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:35.286479 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-5c630e07-f9d1-4115-a2e6-5d9683570e1c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:35.419353 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-5c630e07-f9d1-4115-a2e6-5d9683570e1c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:35.427689 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-5c630e07-f9d1-4115-a2e6-5d9683570e1c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576" status: 200 len: 1265 microversion: 2.1 time: 0.155250 Oct 11 12:13:35.428357 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 486/1015] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:13:35 2022] GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:13:36.451774 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-756a7928-c055-4e1a-a4b7-28ce0c162745 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:36.452421 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-756a7928-c055-4e1a-a4b7-28ce0c162745 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 2f69fb21-4f8a-43d4-a5b9-fb52bab23576] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:36.459587 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-756a7928-c055-4e1a-a4b7-28ce0c162745 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:36.460063 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-756a7928-c055-4e1a-a4b7-28ce0c162745 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:36.460505 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-756a7928-c055-4e1a-a4b7-28ce0c162745 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:36.461198 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-756a7928-c055-4e1a-a4b7-28ce0c162745 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:36.461645 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-756a7928-c055-4e1a-a4b7-28ce0c162745 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:36.462064 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-756a7928-c055-4e1a-a4b7-28ce0c162745 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:36.599875 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-756a7928-c055-4e1a-a4b7-28ce0c162745 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:36.608193 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-756a7928-c055-4e1a-a4b7-28ce0c162745 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576" status: 200 len: 1265 microversion: 2.1 time: 0.160358 Oct 11 12:13:36.608760 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 530/1016] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:13:36 2022] GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:13:37.406801 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-40918373-fc95-4e7a-809a-2c31f821a534 req-ced16246-9d86-4436-8b89-0d2732fbbbb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f69fb21-4f8a-43d4-a5b9-fb52bab23576", "name": "network-vif-plugged", "status": "completed", "tag": "561b9fa3-a590-499e-8240-53039a11fd5f"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:13:37.419838 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-40918373-fc95-4e7a-809a-2c31f821a534 req-ced16246-9d86-4436-8b89-0d2732fbbbb0 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:37.420656 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-40918373-fc95-4e7a-809a-2c31f821a534 req-ced16246-9d86-4436-8b89-0d2732fbbbb0 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:37.421087 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-40918373-fc95-4e7a-809a-2c31f821a534 req-ced16246-9d86-4436-8b89-0d2732fbbbb0 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:37.433099 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-40918373-fc95-4e7a-809a-2c31f821a534 req-ced16246-9d86-4436-8b89-0d2732fbbbb0 service nova] Creating event network-vif-plugged:561b9fa3-a590-499e-8240-53039a11fd5f for instance 2f69fb21-4f8a-43d4-a5b9-fb52bab23576 on hv-cinder-82099 Oct 11 12:13:37.438438 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-40918373-fc95-4e7a-809a-2c31f821a534 req-ced16246-9d86-4436-8b89-0d2732fbbbb0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035550 Oct 11 12:13:37.439234 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 487/1017] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:13:37.631510 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-73da6a4e-b9ee-4dfe-9ff4-7b655b4f6a50 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:37.632135 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-73da6a4e-b9ee-4dfe-9ff4-7b655b4f6a50 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 2f69fb21-4f8a-43d4-a5b9-fb52bab23576] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:37.638914 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-73da6a4e-b9ee-4dfe-9ff4-7b655b4f6a50 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:37.639405 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-73da6a4e-b9ee-4dfe-9ff4-7b655b4f6a50 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:37.639830 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-73da6a4e-b9ee-4dfe-9ff4-7b655b4f6a50 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:37.640583 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-73da6a4e-b9ee-4dfe-9ff4-7b655b4f6a50 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:37.640989 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-73da6a4e-b9ee-4dfe-9ff4-7b655b4f6a50 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:37.641407 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-73da6a4e-b9ee-4dfe-9ff4-7b655b4f6a50 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:37.838826 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-73da6a4e-b9ee-4dfe-9ff4-7b655b4f6a50 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:37.850623 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-73da6a4e-b9ee-4dfe-9ff4-7b655b4f6a50 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576" status: 200 len: 1265 microversion: 2.1 time: 0.222793 Oct 11 12:13:37.851419 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 531/1018] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:13:37 2022] GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576 => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:13:38.881345 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-271be931-3a75-4bb5-b9f8-8f9a7d902ea5 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:38.882326 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-271be931-3a75-4bb5-b9f8-8f9a7d902ea5 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 2f69fb21-4f8a-43d4-a5b9-fb52bab23576] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:38.892134 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-271be931-3a75-4bb5-b9f8-8f9a7d902ea5 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:38.892791 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-271be931-3a75-4bb5-b9f8-8f9a7d902ea5 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:38.893406 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-271be931-3a75-4bb5-b9f8-8f9a7d902ea5 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:38.894836 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-271be931-3a75-4bb5-b9f8-8f9a7d902ea5 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:38.895435 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-271be931-3a75-4bb5-b9f8-8f9a7d902ea5 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:38.895848 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-271be931-3a75-4bb5-b9f8-8f9a7d902ea5 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:39.037700 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-271be931-3a75-4bb5-b9f8-8f9a7d902ea5 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:39.046079 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-271be931-3a75-4bb5-b9f8-8f9a7d902ea5 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576" status: 200 len: 1265 microversion: 2.1 time: 0.170845 Oct 11 12:13:39.046680 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 488/1019] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:13:38 2022] GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:13:39.643364 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-85a7a025-b5a1-4d6b-a41e-54793d2c6b63 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:13:39.646438 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-85a7a025-b5a1-4d6b-a41e-54793d2c6b63 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:39.653318 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-85a7a025-b5a1-4d6b-a41e-54793d2c6b63 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:39.653779 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-85a7a025-b5a1-4d6b-a41e-54793d2c6b63 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:39.654200 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-85a7a025-b5a1-4d6b-a41e-54793d2c6b63 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:39.654951 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-85a7a025-b5a1-4d6b-a41e-54793d2c6b63 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:39.655376 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-85a7a025-b5a1-4d6b-a41e-54793d2c6b63 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:39.655787 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-85a7a025-b5a1-4d6b-a41e-54793d2c6b63 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:39.732759 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-85a7a025-b5a1-4d6b-a41e-54793d2c6b63 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "POST /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac/action" status: 202 len: 0 microversion: 2.1 time: 0.097177 Oct 11 12:13:39.733414 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 532/1020] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Oct 11 12:13:39 2022] POST /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 12:13:39.743798 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-281ac587-2662-48b1-8437-67bcacfb6987 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:39.744594 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-281ac587-2662-48b1-8437-67bcacfb6987 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:39.750766 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-281ac587-2662-48b1-8437-67bcacfb6987 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:39.751315 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-281ac587-2662-48b1-8437-67bcacfb6987 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:39.751795 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-281ac587-2662-48b1-8437-67bcacfb6987 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:39.752547 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-281ac587-2662-48b1-8437-67bcacfb6987 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:39.753030 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-281ac587-2662-48b1-8437-67bcacfb6987 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:39.754030 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-281ac587-2662-48b1-8437-67bcacfb6987 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:39.915303 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-281ac587-2662-48b1-8437-67bcacfb6987 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:39.924209 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-281ac587-2662-48b1-8437-67bcacfb6987 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1752 microversion: 2.1 time: 0.185993 Oct 11 12:13:39.924786 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 489/1021] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:13:39 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1752 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:13:40.069733 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0ed039d2-1caf-4ca0-962b-35dcc68bd3d6 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:40.070426 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0ed039d2-1caf-4ca0-962b-35dcc68bd3d6 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 2f69fb21-4f8a-43d4-a5b9-fb52bab23576] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:40.077069 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0ed039d2-1caf-4ca0-962b-35dcc68bd3d6 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:40.077540 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0ed039d2-1caf-4ca0-962b-35dcc68bd3d6 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:40.078009 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0ed039d2-1caf-4ca0-962b-35dcc68bd3d6 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:40.079312 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0ed039d2-1caf-4ca0-962b-35dcc68bd3d6 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:40.079935 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0ed039d2-1caf-4ca0-962b-35dcc68bd3d6 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:40.080576 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0ed039d2-1caf-4ca0-962b-35dcc68bd3d6 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:40.293897 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0ed039d2-1caf-4ca0-962b-35dcc68bd3d6 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:40.302445 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0ed039d2-1caf-4ca0-962b-35dcc68bd3d6 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576" status: 200 len: 1451 microversion: 2.1 time: 0.237105 Oct 11 12:13:40.303156 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 533/1022] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:13:40 2022] GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576 => generated 1451 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:13:40.325615 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-df281aae-984b-4e8c-939d-d88fd7742965 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:40.326224 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-df281aae-984b-4e8c-939d-d88fd7742965 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 2f69fb21-4f8a-43d4-a5b9-fb52bab23576] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:40.333478 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-df281aae-984b-4e8c-939d-d88fd7742965 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:40.333963 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-df281aae-984b-4e8c-939d-d88fd7742965 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:40.334395 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-df281aae-984b-4e8c-939d-d88fd7742965 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:40.335124 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-df281aae-984b-4e8c-939d-d88fd7742965 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:40.335576 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-df281aae-984b-4e8c-939d-d88fd7742965 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:40.335996 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-df281aae-984b-4e8c-939d-d88fd7742965 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:40.470637 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-df281aae-984b-4e8c-939d-d88fd7742965 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:40.478783 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-df281aae-984b-4e8c-939d-d88fd7742965 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576" status: 200 len: 1451 microversion: 2.1 time: 0.157041 Oct 11 12:13:40.479358 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 490/1023] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:13:40 2022] GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:13:40.947554 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-60891ce5-f9f7-4468-8e58-7b4a330a3d95 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:40.948166 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-60891ce5-f9f7-4468-8e58-7b4a330a3d95 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:40.955207 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-60891ce5-f9f7-4468-8e58-7b4a330a3d95 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:40.955678 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-60891ce5-f9f7-4468-8e58-7b4a330a3d95 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:40.956089 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-60891ce5-f9f7-4468-8e58-7b4a330a3d95 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:40.956773 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-60891ce5-f9f7-4468-8e58-7b4a330a3d95 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:40.957213 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-60891ce5-f9f7-4468-8e58-7b4a330a3d95 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:40.961813 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-60891ce5-f9f7-4468-8e58-7b4a330a3d95 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:41.183142 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-60891ce5-f9f7-4468-8e58-7b4a330a3d95 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:41.192517 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-60891ce5-f9f7-4468-8e58-7b4a330a3d95 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1757 microversion: 2.1 time: 0.248999 Oct 11 12:13:41.194726 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 534/1024] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:13:40 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1757 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:13:42.218018 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-f810b51f-a2d5-4da2-b4df-b110d621b2a2 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:42.218595 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-f810b51f-a2d5-4da2-b4df-b110d621b2a2 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:42.225422 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f810b51f-a2d5-4da2-b4df-b110d621b2a2 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:42.225893 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f810b51f-a2d5-4da2-b4df-b110d621b2a2 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:42.226313 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f810b51f-a2d5-4da2-b4df-b110d621b2a2 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:42.227039 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f810b51f-a2d5-4da2-b4df-b110d621b2a2 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:42.227477 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f810b51f-a2d5-4da2-b4df-b110d621b2a2 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:42.227869 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f810b51f-a2d5-4da2-b4df-b110d621b2a2 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:42.374251 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-f810b51f-a2d5-4da2-b4df-b110d621b2a2 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:42.382811 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-f810b51f-a2d5-4da2-b4df-b110d621b2a2 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1757 microversion: 2.1 time: 0.168742 Oct 11 12:13:42.383423 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 491/1025] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:13:42 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:13:42.621246 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-620af8ff-130a-4c14-8f58-68b93d74b076 req-c67ce83e-6042-4c3d-a940-8357d6fcefa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f69fb21-4f8a-43d4-a5b9-fb52bab23576", "tag": "561b9fa3-a590-499e-8240-53039a11fd5f"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:13:42.631714 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-620af8ff-130a-4c14-8f58-68b93d74b076 req-c67ce83e-6042-4c3d-a940-8357d6fcefa8 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:42.632305 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-620af8ff-130a-4c14-8f58-68b93d74b076 req-c67ce83e-6042-4c3d-a940-8357d6fcefa8 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:42.632742 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-620af8ff-130a-4c14-8f58-68b93d74b076 req-c67ce83e-6042-4c3d-a940-8357d6fcefa8 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:42.643970 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-620af8ff-130a-4c14-8f58-68b93d74b076 req-c67ce83e-6042-4c3d-a940-8357d6fcefa8 service nova] Creating event network-changed:561b9fa3-a590-499e-8240-53039a11fd5f for instance 2f69fb21-4f8a-43d4-a5b9-fb52bab23576 on hv-cinder-82099 Oct 11 12:13:42.649456 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-620af8ff-130a-4c14-8f58-68b93d74b076 req-c67ce83e-6042-4c3d-a940-8357d6fcefa8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032040 Oct 11 12:13:42.650058 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 535/1026] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:13:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:13:43.407024 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-2963fd99-3e83-40f2-b3f5-c213edbb354e tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:43.407701 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-2963fd99-3e83-40f2-b3f5-c213edbb354e tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:43.415090 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2963fd99-3e83-40f2-b3f5-c213edbb354e tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:43.415571 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2963fd99-3e83-40f2-b3f5-c213edbb354e tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:43.416032 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2963fd99-3e83-40f2-b3f5-c213edbb354e tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:43.416722 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2963fd99-3e83-40f2-b3f5-c213edbb354e tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:43.417171 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2963fd99-3e83-40f2-b3f5-c213edbb354e tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:43.417558 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2963fd99-3e83-40f2-b3f5-c213edbb354e tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:43.572926 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-2963fd99-3e83-40f2-b3f5-c213edbb354e tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:43.581528 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-2963fd99-3e83-40f2-b3f5-c213edbb354e tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1757 microversion: 2.1 time: 0.178518 Oct 11 12:13:43.582110 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 492/1027] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:13:43 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:13:44.609732 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-06e56731-b7d9-4ddb-b9a9-bbd47b682e1a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:44.610753 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-06e56731-b7d9-4ddb-b9a9-bbd47b682e1a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:44.618218 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06e56731-b7d9-4ddb-b9a9-bbd47b682e1a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:44.618728 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06e56731-b7d9-4ddb-b9a9-bbd47b682e1a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:44.619157 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06e56731-b7d9-4ddb-b9a9-bbd47b682e1a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:44.619841 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06e56731-b7d9-4ddb-b9a9-bbd47b682e1a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:44.620261 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06e56731-b7d9-4ddb-b9a9-bbd47b682e1a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:44.620706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06e56731-b7d9-4ddb-b9a9-bbd47b682e1a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:44.767356 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-06e56731-b7d9-4ddb-b9a9-bbd47b682e1a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:44.777188 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-06e56731-b7d9-4ddb-b9a9-bbd47b682e1a tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1757 microversion: 2.1 time: 0.174483 Oct 11 12:13:44.777761 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 536/1028] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:13:44 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:13:45.800829 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-e93d18ee-a6b5-4044-bb49-f07639e8967c tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:45.801444 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-e93d18ee-a6b5-4044-bb49-f07639e8967c tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:45.808372 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e93d18ee-a6b5-4044-bb49-f07639e8967c tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:45.808848 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e93d18ee-a6b5-4044-bb49-f07639e8967c tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:45.809274 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e93d18ee-a6b5-4044-bb49-f07639e8967c tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:45.809939 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e93d18ee-a6b5-4044-bb49-f07639e8967c tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:45.810381 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e93d18ee-a6b5-4044-bb49-f07639e8967c tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:45.810820 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e93d18ee-a6b5-4044-bb49-f07639e8967c tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:45.964122 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-e93d18ee-a6b5-4044-bb49-f07639e8967c tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:45.972724 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-e93d18ee-a6b5-4044-bb49-f07639e8967c tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1757 microversion: 2.1 time: 0.175864 Oct 11 12:13:45.973312 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 493/1029] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:13:45 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:13:46.997243 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a0738662-3f27-4795-99e6-5a3c1f25333c tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:46.997823 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a0738662-3f27-4795-99e6-5a3c1f25333c tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:47.004962 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0738662-3f27-4795-99e6-5a3c1f25333c tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:47.005435 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0738662-3f27-4795-99e6-5a3c1f25333c tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:47.005867 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0738662-3f27-4795-99e6-5a3c1f25333c tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:47.006624 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0738662-3f27-4795-99e6-5a3c1f25333c tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:47.007027 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0738662-3f27-4795-99e6-5a3c1f25333c tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:47.007440 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a0738662-3f27-4795-99e6-5a3c1f25333c tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:47.160497 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a0738662-3f27-4795-99e6-5a3c1f25333c tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:47.170112 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a0738662-3f27-4795-99e6-5a3c1f25333c tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1757 microversion: 2.1 time: 0.177060 Oct 11 12:13:47.170712 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 537/1030] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:13:46 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:13:48.196063 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-9b8328ed-c843-4e3d-bada-74d3370d34c1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:48.196691 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-9b8328ed-c843-4e3d-bada-74d3370d34c1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:48.203723 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9b8328ed-c843-4e3d-bada-74d3370d34c1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:48.204207 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9b8328ed-c843-4e3d-bada-74d3370d34c1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:48.204641 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9b8328ed-c843-4e3d-bada-74d3370d34c1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:48.205338 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9b8328ed-c843-4e3d-bada-74d3370d34c1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:48.205791 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9b8328ed-c843-4e3d-bada-74d3370d34c1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:48.206218 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9b8328ed-c843-4e3d-bada-74d3370d34c1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:48.357045 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-9b8328ed-c843-4e3d-bada-74d3370d34c1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:48.368289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-9b8328ed-c843-4e3d-bada-74d3370d34c1 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1757 microversion: 2.1 time: 0.177511 Oct 11 12:13:48.368871 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 494/1031] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:13:48 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1757 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:13:49.393709 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b6b965d2-fb35-4808-8770-fde070643e1b tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:49.394706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-b6b965d2-fb35-4808-8770-fde070643e1b tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:49.401129 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b6b965d2-fb35-4808-8770-fde070643e1b tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:49.401615 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b6b965d2-fb35-4808-8770-fde070643e1b tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:49.402249 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b6b965d2-fb35-4808-8770-fde070643e1b tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:49.402994 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b6b965d2-fb35-4808-8770-fde070643e1b tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:49.403610 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b6b965d2-fb35-4808-8770-fde070643e1b tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:49.403866 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b6b965d2-fb35-4808-8770-fde070643e1b tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:49.558468 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-b6b965d2-fb35-4808-8770-fde070643e1b tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:49.571238 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b6b965d2-fb35-4808-8770-fde070643e1b tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1757 microversion: 2.1 time: 0.181516 Oct 11 12:13:49.572143 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 538/1032] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:13:49 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1757 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:13:50.596677 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-70f3ba09-07f4-4093-9461-11d1c9b18918 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:50.597404 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-70f3ba09-07f4-4093-9461-11d1c9b18918 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:50.604346 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-70f3ba09-07f4-4093-9461-11d1c9b18918 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:50.604850 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-70f3ba09-07f4-4093-9461-11d1c9b18918 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:50.605295 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-70f3ba09-07f4-4093-9461-11d1c9b18918 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:50.606021 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-70f3ba09-07f4-4093-9461-11d1c9b18918 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:50.606484 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-70f3ba09-07f4-4093-9461-11d1c9b18918 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:50.606958 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-70f3ba09-07f4-4093-9461-11d1c9b18918 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:50.761358 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-70f3ba09-07f4-4093-9461-11d1c9b18918 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:50.771656 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-70f3ba09-07f4-4093-9461-11d1c9b18918 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1757 microversion: 2.1 time: 0.179801 Oct 11 12:13:50.772192 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 495/1033] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:13:50 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1757 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:13:51.798146 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-301e6cc1-6e9c-4253-96d8-e1c6522924f4 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:51.799139 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-301e6cc1-6e9c-4253-96d8-e1c6522924f4 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:51.801750 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:13:51.807990 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-301e6cc1-6e9c-4253-96d8-e1c6522924f4 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:51.808460 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-301e6cc1-6e9c-4253-96d8-e1c6522924f4 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:51.808957 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-301e6cc1-6e9c-4253-96d8-e1c6522924f4 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:51.809908 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-301e6cc1-6e9c-4253-96d8-e1c6522924f4 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:51.810634 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-301e6cc1-6e9c-4253-96d8-e1c6522924f4 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:51.811283 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-301e6cc1-6e9c-4253-96d8-e1c6522924f4 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:51.816266 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:13:51.970936 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-301e6cc1-6e9c-4253-96d8-e1c6522924f4 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:51.979849 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-301e6cc1-6e9c-4253-96d8-e1c6522924f4 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1760 microversion: 2.1 time: 0.187734 Oct 11 12:13:51.980413 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 539/1034] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:13:51 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1760 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:13:54.323939 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-6054ccb7-7fb5-4c76-9b6b-c59a95734519 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:54.324702 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-6054ccb7-7fb5-4c76-9b6b-c59a95734519 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:54.327618 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_api:SELECT=35 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:13:54.334991 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6054ccb7-7fb5-4c76-9b6b-c59a95734519 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:54.335767 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6054ccb7-7fb5-4c76-9b6b-c59a95734519 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:54.336276 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6054ccb7-7fb5-4c76-9b6b-c59a95734519 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:54.337246 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6054ccb7-7fb5-4c76-9b6b-c59a95734519 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:54.337939 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6054ccb7-7fb5-4c76-9b6b-c59a95734519 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:54.338484 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6054ccb7-7fb5-4c76-9b6b-c59a95734519 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:54.342338 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=87 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:13:54.364537 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-6054ccb7-7fb5-4c76-9b6b-c59a95734519 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15/ips" status: 200 len: 152 microversion: 2.20 time: 0.231759 Oct 11 12:13:54.365135 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 496/1035] 10.222.0.59 () {60 vars in 1289 bytes} [Tue Oct 11 12:13:54 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15/ips => generated 152 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 12:13:56.222254 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-05c57b7e-97f6-458f-a5bf-7538764e94cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:13:56.223031 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-05c57b7e-97f6-458f-a5bf-7538764e94cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:56.230949 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-05c57b7e-97f6-458f-a5bf-7538764e94cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:56.231445 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-05c57b7e-97f6-458f-a5bf-7538764e94cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:56.231870 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-05c57b7e-97f6-458f-a5bf-7538764e94cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:56.232581 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-05c57b7e-97f6-458f-a5bf-7538764e94cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:56.233028 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-05c57b7e-97f6-458f-a5bf-7538764e94cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:56.233447 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-05c57b7e-97f6-458f-a5bf-7538764e94cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:56.257194 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.objects.instance [None req-05c57b7e-97f6-458f-a5bf-7538764e94cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lazy-loading 'flavor' on Instance uuid 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 {{(pid=118995) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:13:56.480917 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-05c57b7e-97f6-458f-a5bf-7538764e94cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "POST /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15/action" status: 202 len: 0 microversion: 2.20 time: 0.263174 Oct 11 12:13:56.481448 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 540/1036] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Oct 11 12:13:56 2022] POST /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 12:13:56.490455 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-69dc7117-cd47-4405-9ab3-9894c106a8c1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:56.491286 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-69dc7117-cd47-4405-9ab3-9894c106a8c1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:56.497862 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-69dc7117-cd47-4405-9ab3-9894c106a8c1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:56.498412 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-69dc7117-cd47-4405-9ab3-9894c106a8c1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:56.498878 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-69dc7117-cd47-4405-9ab3-9894c106a8c1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:56.499578 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-69dc7117-cd47-4405-9ab3-9894c106a8c1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:56.500076 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-69dc7117-cd47-4405-9ab3-9894c106a8c1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:56.500441 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-69dc7117-cd47-4405-9ab3-9894c106a8c1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:56.635761 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-69dc7117-cd47-4405-9ab3-9894c106a8c1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:56.644749 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-69dc7117-cd47-4405-9ab3-9894c106a8c1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:56.646170 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-69dc7117-cd47-4405-9ab3-9894c106a8c1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:56.647360 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-69dc7117-cd47-4405-9ab3-9894c106a8c1 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1723 microversion: 2.20 time: 0.161479 Oct 11 12:13:56.647936 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 497/1037] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:13:56 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:13:57.676434 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-916a217a-329f-4907-bd84-a6f507545300 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:57.677304 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-916a217a-329f-4907-bd84-a6f507545300 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:57.686153 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-916a217a-329f-4907-bd84-a6f507545300 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:57.686886 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-916a217a-329f-4907-bd84-a6f507545300 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:57.687603 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-916a217a-329f-4907-bd84-a6f507545300 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:57.688791 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-916a217a-329f-4907-bd84-a6f507545300 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:57.689689 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-916a217a-329f-4907-bd84-a6f507545300 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:57.690389 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-916a217a-329f-4907-bd84-a6f507545300 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:57.836941 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-916a217a-329f-4907-bd84-a6f507545300 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:57.845235 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-916a217a-329f-4907-bd84-a6f507545300 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:57.846683 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-916a217a-329f-4907-bd84-a6f507545300 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:57.847847 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-916a217a-329f-4907-bd84-a6f507545300 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1723 microversion: 2.20 time: 0.178211 Oct 11 12:13:57.848394 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 541/1038] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:13:57 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:13:58.876134 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-c616a8cd-dccf-4087-9b75-a9072c8b99ad tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:13:58.876919 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-c616a8cd-dccf-4087-9b75-a9072c8b99ad tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:13:58.885949 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c616a8cd-dccf-4087-9b75-a9072c8b99ad tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:58.886616 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c616a8cd-dccf-4087-9b75-a9072c8b99ad tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:58.887205 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c616a8cd-dccf-4087-9b75-a9072c8b99ad tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:58.888096 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c616a8cd-dccf-4087-9b75-a9072c8b99ad tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:13:58.888697 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c616a8cd-dccf-4087-9b75-a9072c8b99ad tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:13:58.889240 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c616a8cd-dccf-4087-9b75-a9072c8b99ad tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:13:59.033453 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-c616a8cd-dccf-4087-9b75-a9072c8b99ad tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:59.046050 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-c616a8cd-dccf-4087-9b75-a9072c8b99ad tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:59.048250 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-c616a8cd-dccf-4087-9b75-a9072c8b99ad tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:13:59.049999 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-c616a8cd-dccf-4087-9b75-a9072c8b99ad tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1723 microversion: 2.20 time: 0.179070 Oct 11 12:13:59.050816 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 498/1039] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:13:58 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:00.076582 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6096d5b4-742d-4390-a827-ef153f9bcba4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:00.077162 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-6096d5b4-742d-4390-a827-ef153f9bcba4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:00.084272 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6096d5b4-742d-4390-a827-ef153f9bcba4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:00.084720 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6096d5b4-742d-4390-a827-ef153f9bcba4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:00.085108 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6096d5b4-742d-4390-a827-ef153f9bcba4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:00.085824 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6096d5b4-742d-4390-a827-ef153f9bcba4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:00.086264 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6096d5b4-742d-4390-a827-ef153f9bcba4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:00.086710 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6096d5b4-742d-4390-a827-ef153f9bcba4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:00.237388 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6096d5b4-742d-4390-a827-ef153f9bcba4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:00.245870 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6096d5b4-742d-4390-a827-ef153f9bcba4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:00.247321 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6096d5b4-742d-4390-a827-ef153f9bcba4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:00.248520 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6096d5b4-742d-4390-a827-ef153f9bcba4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1723 microversion: 2.20 time: 0.175974 Oct 11 12:14:00.249073 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 542/1040] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:00 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:01.283120 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-55281775-f8d8-40de-abc8-6b6ee0f3dfd9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:01.283795 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-55281775-f8d8-40de-abc8-6b6ee0f3dfd9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:01.290623 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-55281775-f8d8-40de-abc8-6b6ee0f3dfd9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:01.291108 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-55281775-f8d8-40de-abc8-6b6ee0f3dfd9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:01.291539 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-55281775-f8d8-40de-abc8-6b6ee0f3dfd9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:01.292507 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-55281775-f8d8-40de-abc8-6b6ee0f3dfd9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:01.293989 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-55281775-f8d8-40de-abc8-6b6ee0f3dfd9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:01.293989 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-55281775-f8d8-40de-abc8-6b6ee0f3dfd9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:01.440492 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-55281775-f8d8-40de-abc8-6b6ee0f3dfd9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:01.449094 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-55281775-f8d8-40de-abc8-6b6ee0f3dfd9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:01.450542 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-55281775-f8d8-40de-abc8-6b6ee0f3dfd9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:01.451896 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-55281775-f8d8-40de-abc8-6b6ee0f3dfd9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1723 microversion: 2.20 time: 0.173085 Oct 11 12:14:01.452801 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 499/1041] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:01 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:02.479128 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-67de9a37-cea1-4380-b3f9-11d868a13282 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:02.479840 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-67de9a37-cea1-4380-b3f9-11d868a13282 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:02.488425 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-67de9a37-cea1-4380-b3f9-11d868a13282 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:02.489014 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-67de9a37-cea1-4380-b3f9-11d868a13282 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:02.489642 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-67de9a37-cea1-4380-b3f9-11d868a13282 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:02.490400 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-67de9a37-cea1-4380-b3f9-11d868a13282 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:02.491317 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-67de9a37-cea1-4380-b3f9-11d868a13282 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:02.491501 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-67de9a37-cea1-4380-b3f9-11d868a13282 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:02.641404 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-67de9a37-cea1-4380-b3f9-11d868a13282 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:02.650301 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-67de9a37-cea1-4380-b3f9-11d868a13282 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:02.651758 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-67de9a37-cea1-4380-b3f9-11d868a13282 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:02.653078 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-67de9a37-cea1-4380-b3f9-11d868a13282 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1723 microversion: 2.20 time: 0.178934 Oct 11 12:14:02.653645 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 543/1042] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:02 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:03.678218 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-37d14a40-9ce9-4bd0-8d45-b9dfd934569b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:03.678879 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-37d14a40-9ce9-4bd0-8d45-b9dfd934569b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:03.685964 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-37d14a40-9ce9-4bd0-8d45-b9dfd934569b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:03.686490 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-37d14a40-9ce9-4bd0-8d45-b9dfd934569b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:03.686932 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-37d14a40-9ce9-4bd0-8d45-b9dfd934569b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:03.687616 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-37d14a40-9ce9-4bd0-8d45-b9dfd934569b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:03.688098 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-37d14a40-9ce9-4bd0-8d45-b9dfd934569b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:03.688528 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-37d14a40-9ce9-4bd0-8d45-b9dfd934569b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:03.827643 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-37d14a40-9ce9-4bd0-8d45-b9dfd934569b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:03.838245 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-37d14a40-9ce9-4bd0-8d45-b9dfd934569b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:03.839876 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-37d14a40-9ce9-4bd0-8d45-b9dfd934569b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:03.841085 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-37d14a40-9ce9-4bd0-8d45-b9dfd934569b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1723 microversion: 2.20 time: 0.166908 Oct 11 12:14:03.841636 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 500/1043] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:03 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:04.877613 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0e4b5ed8-2629-44f8-9294-e682b14820cf tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:04.878323 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0e4b5ed8-2629-44f8-9294-e682b14820cf tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:04.886529 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0e4b5ed8-2629-44f8-9294-e682b14820cf tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:04.887146 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0e4b5ed8-2629-44f8-9294-e682b14820cf tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:04.887682 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0e4b5ed8-2629-44f8-9294-e682b14820cf tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:04.888504 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0e4b5ed8-2629-44f8-9294-e682b14820cf tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:04.889046 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0e4b5ed8-2629-44f8-9294-e682b14820cf tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:04.889557 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0e4b5ed8-2629-44f8-9294-e682b14820cf tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:05.025228 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0e4b5ed8-2629-44f8-9294-e682b14820cf tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:05.037443 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0e4b5ed8-2629-44f8-9294-e682b14820cf tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:05.039551 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0e4b5ed8-2629-44f8-9294-e682b14820cf tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:05.041327 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0e4b5ed8-2629-44f8-9294-e682b14820cf tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1723 microversion: 2.20 time: 0.168222 Oct 11 12:14:05.042062 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 544/1044] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:04 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:06.069073 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-cb006ca8-9bd5-407b-b742-c450ce45c53f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:06.069762 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-cb006ca8-9bd5-407b-b742-c450ce45c53f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:06.078015 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cb006ca8-9bd5-407b-b742-c450ce45c53f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:06.078476 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cb006ca8-9bd5-407b-b742-c450ce45c53f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:06.078932 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cb006ca8-9bd5-407b-b742-c450ce45c53f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:06.079613 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cb006ca8-9bd5-407b-b742-c450ce45c53f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:06.080058 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cb006ca8-9bd5-407b-b742-c450ce45c53f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:06.080472 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cb006ca8-9bd5-407b-b742-c450ce45c53f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:06.225485 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-cb006ca8-9bd5-407b-b742-c450ce45c53f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:06.237608 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-cb006ca8-9bd5-407b-b742-c450ce45c53f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:06.239901 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-cb006ca8-9bd5-407b-b742-c450ce45c53f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:06.241626 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-cb006ca8-9bd5-407b-b742-c450ce45c53f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1723 microversion: 2.20 time: 0.178138 Oct 11 12:14:06.242401 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 501/1045] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:06 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:07.268603 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-086289ef-e023-4469-b837-eb2a56a7348b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:07.269186 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-086289ef-e023-4469-b837-eb2a56a7348b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:07.276680 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-086289ef-e023-4469-b837-eb2a56a7348b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:07.277164 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-086289ef-e023-4469-b837-eb2a56a7348b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:07.277595 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-086289ef-e023-4469-b837-eb2a56a7348b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:07.278287 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-086289ef-e023-4469-b837-eb2a56a7348b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:07.278777 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-086289ef-e023-4469-b837-eb2a56a7348b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:07.279196 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-086289ef-e023-4469-b837-eb2a56a7348b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:07.420913 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-086289ef-e023-4469-b837-eb2a56a7348b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:07.429557 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-086289ef-e023-4469-b837-eb2a56a7348b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:07.431029 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-086289ef-e023-4469-b837-eb2a56a7348b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:07.432198 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-086289ef-e023-4469-b837-eb2a56a7348b tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1723 microversion: 2.20 time: 0.167752 Oct 11 12:14:07.432842 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 545/1046] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:07 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:08.458244 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-44197b7a-4d06-4ccc-80e3-96a1cc3e2847 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:08.458878 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-44197b7a-4d06-4ccc-80e3-96a1cc3e2847 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:08.465918 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-44197b7a-4d06-4ccc-80e3-96a1cc3e2847 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:08.466436 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-44197b7a-4d06-4ccc-80e3-96a1cc3e2847 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:08.466910 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-44197b7a-4d06-4ccc-80e3-96a1cc3e2847 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:08.467602 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-44197b7a-4d06-4ccc-80e3-96a1cc3e2847 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:08.468025 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-44197b7a-4d06-4ccc-80e3-96a1cc3e2847 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:08.468457 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-44197b7a-4d06-4ccc-80e3-96a1cc3e2847 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:08.600270 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-44197b7a-4d06-4ccc-80e3-96a1cc3e2847 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:08.609041 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-44197b7a-4d06-4ccc-80e3-96a1cc3e2847 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:08.610482 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-44197b7a-4d06-4ccc-80e3-96a1cc3e2847 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:08.611680 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-44197b7a-4d06-4ccc-80e3-96a1cc3e2847 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1744 microversion: 2.20 time: 0.158149 Oct 11 12:14:08.612243 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 502/1047] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:08 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:09.637298 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-cd40711c-3d28-468b-b04a-16f5aac64c27 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:09.637900 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-cd40711c-3d28-468b-b04a-16f5aac64c27 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:09.645092 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd40711c-3d28-468b-b04a-16f5aac64c27 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:09.645560 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd40711c-3d28-468b-b04a-16f5aac64c27 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:09.645986 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd40711c-3d28-468b-b04a-16f5aac64c27 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:09.646687 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd40711c-3d28-468b-b04a-16f5aac64c27 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:09.647208 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd40711c-3d28-468b-b04a-16f5aac64c27 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:09.647536 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd40711c-3d28-468b-b04a-16f5aac64c27 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:09.804568 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-cd40711c-3d28-468b-b04a-16f5aac64c27 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:09.813180 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-cd40711c-3d28-468b-b04a-16f5aac64c27 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:09.814628 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-cd40711c-3d28-468b-b04a-16f5aac64c27 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:09.815821 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-cd40711c-3d28-468b-b04a-16f5aac64c27 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1744 microversion: 2.20 time: 0.182484 Oct 11 12:14:09.816398 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 546/1048] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:09 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1744 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:10.842205 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-72d42e41-448b-4d47-bfe8-ef368f3b4ef9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:10.842864 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-72d42e41-448b-4d47-bfe8-ef368f3b4ef9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:10.849713 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-72d42e41-448b-4d47-bfe8-ef368f3b4ef9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:10.850181 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-72d42e41-448b-4d47-bfe8-ef368f3b4ef9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:10.850646 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-72d42e41-448b-4d47-bfe8-ef368f3b4ef9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:10.851344 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-72d42e41-448b-4d47-bfe8-ef368f3b4ef9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:10.851793 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-72d42e41-448b-4d47-bfe8-ef368f3b4ef9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:10.852225 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-72d42e41-448b-4d47-bfe8-ef368f3b4ef9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:10.989705 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-72d42e41-448b-4d47-bfe8-ef368f3b4ef9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:10.998642 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-72d42e41-448b-4d47-bfe8-ef368f3b4ef9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:11.000170 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-72d42e41-448b-4d47-bfe8-ef368f3b4ef9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:11.001328 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-72d42e41-448b-4d47-bfe8-ef368f3b4ef9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1744 microversion: 2.20 time: 0.163327 Oct 11 12:14:11.001903 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 503/1049] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:10 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:11.530921 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-76c68ed9-36a7-4836-966f-7cdea8796dfa req-a0357fec-3bb1-4b7d-b32b-350034b6d9aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f7ef566-fc3f-4b87-96a7-2d2a650a4d15", "name": "network-vif-plugged", "status": "completed", "tag": "587860e6-e550-42be-bb20-fe198f47ec93"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:14:11.540947 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-76c68ed9-36a7-4836-966f-7cdea8796dfa req-a0357fec-3bb1-4b7d-b32b-350034b6d9aa service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:11.541413 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-76c68ed9-36a7-4836-966f-7cdea8796dfa req-a0357fec-3bb1-4b7d-b32b-350034b6d9aa service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:11.541816 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-76c68ed9-36a7-4836-966f-7cdea8796dfa req-a0357fec-3bb1-4b7d-b32b-350034b6d9aa service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:11.553766 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-76c68ed9-36a7-4836-966f-7cdea8796dfa req-a0357fec-3bb1-4b7d-b32b-350034b6d9aa service nova] Creating event network-vif-plugged:587860e6-e550-42be-bb20-fe198f47ec93 for instance 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 on hv-cinder-82099 Oct 11 12:14:11.559376 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-76c68ed9-36a7-4836-966f-7cdea8796dfa req-a0357fec-3bb1-4b7d-b32b-350034b6d9aa service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032458 Oct 11 12:14:11.560323 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 547/1050] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:14:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 12:14:12.031178 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-74ebceaa-5f0d-4447-b718-71abda4a2df8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:12.031831 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-74ebceaa-5f0d-4447-b718-71abda4a2df8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:12.038986 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-74ebceaa-5f0d-4447-b718-71abda4a2df8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:12.039461 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-74ebceaa-5f0d-4447-b718-71abda4a2df8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:12.039882 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-74ebceaa-5f0d-4447-b718-71abda4a2df8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:12.040577 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-74ebceaa-5f0d-4447-b718-71abda4a2df8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:12.041019 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-74ebceaa-5f0d-4447-b718-71abda4a2df8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:12.041437 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-74ebceaa-5f0d-4447-b718-71abda4a2df8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:12.178544 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-74ebceaa-5f0d-4447-b718-71abda4a2df8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:12.186867 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-74ebceaa-5f0d-4447-b718-71abda4a2df8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:12.188318 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-74ebceaa-5f0d-4447-b718-71abda4a2df8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:12.189479 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-74ebceaa-5f0d-4447-b718-71abda4a2df8 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1744 microversion: 2.20 time: 0.162589 Oct 11 12:14:12.190036 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 504/1051] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:12 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1744 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:13.215942 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0dc71827-6f81-474f-b070-ace843d8474c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:13.216805 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0dc71827-6f81-474f-b070-ace843d8474c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:13.223478 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0dc71827-6f81-474f-b070-ace843d8474c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:13.223959 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0dc71827-6f81-474f-b070-ace843d8474c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:13.224416 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0dc71827-6f81-474f-b070-ace843d8474c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:13.225111 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0dc71827-6f81-474f-b070-ace843d8474c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:13.225559 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0dc71827-6f81-474f-b070-ace843d8474c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:13.225978 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0dc71827-6f81-474f-b070-ace843d8474c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:13.370911 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0dc71827-6f81-474f-b070-ace843d8474c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:13.379979 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0dc71827-6f81-474f-b070-ace843d8474c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:13.381543 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0dc71827-6f81-474f-b070-ace843d8474c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:13.383006 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0dc71827-6f81-474f-b070-ace843d8474c tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1744 microversion: 2.20 time: 0.172012 Oct 11 12:14:13.383613 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 548/1052] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:13 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1744 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:14.414201 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-1fbd2db3-448c-4635-abe7-01537d0a75e6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:14.414945 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-1fbd2db3-448c-4635-abe7-01537d0a75e6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:14.422139 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1fbd2db3-448c-4635-abe7-01537d0a75e6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:14.422768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1fbd2db3-448c-4635-abe7-01537d0a75e6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:14.423196 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1fbd2db3-448c-4635-abe7-01537d0a75e6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:14.423931 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1fbd2db3-448c-4635-abe7-01537d0a75e6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:14.424376 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1fbd2db3-448c-4635-abe7-01537d0a75e6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:14.424797 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1fbd2db3-448c-4635-abe7-01537d0a75e6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:14.601950 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-1fbd2db3-448c-4635-abe7-01537d0a75e6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:14.610692 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-1fbd2db3-448c-4635-abe7-01537d0a75e6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:14.612540 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-1fbd2db3-448c-4635-abe7-01537d0a75e6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:14.614165 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-1fbd2db3-448c-4635-abe7-01537d0a75e6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1739 microversion: 2.20 time: 0.207538 Oct 11 12:14:14.615058 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 505/1053] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:14 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:15.642049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f82a2a83-47c9-46de-8099-86a0c007368a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:15.643618 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f82a2a83-47c9-46de-8099-86a0c007368a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:15.650815 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f82a2a83-47c9-46de-8099-86a0c007368a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:15.651597 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f82a2a83-47c9-46de-8099-86a0c007368a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:15.652256 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f82a2a83-47c9-46de-8099-86a0c007368a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:15.653379 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f82a2a83-47c9-46de-8099-86a0c007368a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:15.653747 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f82a2a83-47c9-46de-8099-86a0c007368a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:15.654296 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f82a2a83-47c9-46de-8099-86a0c007368a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:15.808152 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f82a2a83-47c9-46de-8099-86a0c007368a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:15.819934 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f82a2a83-47c9-46de-8099-86a0c007368a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:15.821510 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f82a2a83-47c9-46de-8099-86a0c007368a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:15.822710 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f82a2a83-47c9-46de-8099-86a0c007368a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1739 microversion: 2.20 time: 0.185556 Oct 11 12:14:15.823266 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 549/1054] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:15 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:16.850316 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-9423e08c-a5dd-43f4-8c7a-5dd1c21b8c0f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:16.851909 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-9423e08c-a5dd-43f4-8c7a-5dd1c21b8c0f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:16.860996 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9423e08c-a5dd-43f4-8c7a-5dd1c21b8c0f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:16.861919 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9423e08c-a5dd-43f4-8c7a-5dd1c21b8c0f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:16.862367 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9423e08c-a5dd-43f4-8c7a-5dd1c21b8c0f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:16.863127 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9423e08c-a5dd-43f4-8c7a-5dd1c21b8c0f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:16.863594 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9423e08c-a5dd-43f4-8c7a-5dd1c21b8c0f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:16.864013 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9423e08c-a5dd-43f4-8c7a-5dd1c21b8c0f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:17.040996 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-9423e08c-a5dd-43f4-8c7a-5dd1c21b8c0f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:17.050472 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-9423e08c-a5dd-43f4-8c7a-5dd1c21b8c0f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:17.052241 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-9423e08c-a5dd-43f4-8c7a-5dd1c21b8c0f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:17.053638 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-9423e08c-a5dd-43f4-8c7a-5dd1c21b8c0f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1739 microversion: 2.20 time: 0.208736 Oct 11 12:14:17.054201 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 506/1055] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:16 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:18.079635 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-cd917dd9-19f2-4ca1-bef2-3b727fa1e128 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:18.080373 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-cd917dd9-19f2-4ca1-bef2-3b727fa1e128 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:18.087435 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd917dd9-19f2-4ca1-bef2-3b727fa1e128 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:18.087912 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd917dd9-19f2-4ca1-bef2-3b727fa1e128 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:18.088313 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd917dd9-19f2-4ca1-bef2-3b727fa1e128 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:18.089289 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd917dd9-19f2-4ca1-bef2-3b727fa1e128 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:18.089733 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd917dd9-19f2-4ca1-bef2-3b727fa1e128 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:18.090144 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cd917dd9-19f2-4ca1-bef2-3b727fa1e128 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:18.234957 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-cd917dd9-19f2-4ca1-bef2-3b727fa1e128 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:18.244038 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-cd917dd9-19f2-4ca1-bef2-3b727fa1e128 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:18.245564 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-cd917dd9-19f2-4ca1-bef2-3b727fa1e128 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:18.246669 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-cd917dd9-19f2-4ca1-bef2-3b727fa1e128 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1739 microversion: 2.20 time: 0.171154 Oct 11 12:14:18.247513 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 550/1056] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:18 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:19.275112 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-ce7364c1-5551-44b1-9648-ff681e637781 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:19.275740 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-ce7364c1-5551-44b1-9648-ff681e637781 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:19.282790 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ce7364c1-5551-44b1-9648-ff681e637781 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:19.283274 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ce7364c1-5551-44b1-9648-ff681e637781 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:19.283722 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ce7364c1-5551-44b1-9648-ff681e637781 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:19.284398 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ce7364c1-5551-44b1-9648-ff681e637781 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:19.284855 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ce7364c1-5551-44b1-9648-ff681e637781 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:19.285270 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ce7364c1-5551-44b1-9648-ff681e637781 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:19.427201 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-ce7364c1-5551-44b1-9648-ff681e637781 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:19.436593 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-ce7364c1-5551-44b1-9648-ff681e637781 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:19.439399 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-ce7364c1-5551-44b1-9648-ff681e637781 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:19.439615 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-ce7364c1-5551-44b1-9648-ff681e637781 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1739 microversion: 2.20 time: 0.170230 Oct 11 12:14:19.440458 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 507/1057] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:19 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:20.465282 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-52415e59-0795-484c-8172-d99e5c28ec24 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:20.466264 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-52415e59-0795-484c-8172-d99e5c28ec24 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:20.473557 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-52415e59-0795-484c-8172-d99e5c28ec24 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:20.473743 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-52415e59-0795-484c-8172-d99e5c28ec24 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:20.474222 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-52415e59-0795-484c-8172-d99e5c28ec24 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:20.474935 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-52415e59-0795-484c-8172-d99e5c28ec24 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:20.475378 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-52415e59-0795-484c-8172-d99e5c28ec24 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:20.475793 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-52415e59-0795-484c-8172-d99e5c28ec24 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:20.622650 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-52415e59-0795-484c-8172-d99e5c28ec24 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:20.631807 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-52415e59-0795-484c-8172-d99e5c28ec24 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:20.633446 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-52415e59-0795-484c-8172-d99e5c28ec24 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:20.638307 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-52415e59-0795-484c-8172-d99e5c28ec24 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1739 microversion: 2.20 time: 0.173259 Oct 11 12:14:20.651157 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 551/1058] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:20 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:21.661636 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-50467843-ad23-4e59-b6e5-0984f046ed9a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:21.662240 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-50467843-ad23-4e59-b6e5-0984f046ed9a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:21.676967 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-50467843-ad23-4e59-b6e5-0984f046ed9a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:21.677435 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-50467843-ad23-4e59-b6e5-0984f046ed9a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:21.677865 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-50467843-ad23-4e59-b6e5-0984f046ed9a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:21.678602 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-50467843-ad23-4e59-b6e5-0984f046ed9a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:21.679030 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-50467843-ad23-4e59-b6e5-0984f046ed9a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:21.679457 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-50467843-ad23-4e59-b6e5-0984f046ed9a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:21.830314 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-50467843-ad23-4e59-b6e5-0984f046ed9a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:21.839466 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-50467843-ad23-4e59-b6e5-0984f046ed9a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:21.841050 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-50467843-ad23-4e59-b6e5-0984f046ed9a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:21.842315 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-50467843-ad23-4e59-b6e5-0984f046ed9a tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1739 microversion: 2.20 time: 0.185200 Oct 11 12:14:21.843081 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 508/1059] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:21 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:22.867872 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-21f143e0-5fde-4719-aff8-ccc4463bb584 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:22.868710 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-21f143e0-5fde-4719-aff8-ccc4463bb584 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:22.871376 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=26 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:14:22.880498 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-21f143e0-5fde-4719-aff8-ccc4463bb584 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:22.880788 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-21f143e0-5fde-4719-aff8-ccc4463bb584 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:22.881472 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-21f143e0-5fde-4719-aff8-ccc4463bb584 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:22.882173 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-21f143e0-5fde-4719-aff8-ccc4463bb584 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:22.882645 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-21f143e0-5fde-4719-aff8-ccc4463bb584 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:22.883303 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-21f143e0-5fde-4719-aff8-ccc4463bb584 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:22.886594 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:14:23.043196 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-21f143e0-5fde-4719-aff8-ccc4463bb584 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:23.052731 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-21f143e0-5fde-4719-aff8-ccc4463bb584 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:23.054309 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-21f143e0-5fde-4719-aff8-ccc4463bb584 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:23.055578 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-21f143e0-5fde-4719-aff8-ccc4463bb584 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1739 microversion: 2.20 time: 0.192015 Oct 11 12:14:23.056213 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 552/1060] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:22 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:24.081251 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-028610ec-60a5-4c44-8fe1-32a71242ede6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:24.081874 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-028610ec-60a5-4c44-8fe1-32a71242ede6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:24.091388 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-028610ec-60a5-4c44-8fe1-32a71242ede6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:24.092487 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-028610ec-60a5-4c44-8fe1-32a71242ede6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:24.092924 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-028610ec-60a5-4c44-8fe1-32a71242ede6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:24.093725 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-028610ec-60a5-4c44-8fe1-32a71242ede6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:24.094116 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-028610ec-60a5-4c44-8fe1-32a71242ede6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:24.094533 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-028610ec-60a5-4c44-8fe1-32a71242ede6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:24.243689 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-028610ec-60a5-4c44-8fe1-32a71242ede6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:24.253289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-028610ec-60a5-4c44-8fe1-32a71242ede6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:24.255302 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-028610ec-60a5-4c44-8fe1-32a71242ede6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:24.256488 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-028610ec-60a5-4c44-8fe1-32a71242ede6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1739 microversion: 2.20 time: 0.179469 Oct 11 12:14:24.257039 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 509/1061] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:24 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:25.282282 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-246b64b0-8681-4b48-96ad-7f0d006cde9e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:25.282924 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-246b64b0-8681-4b48-96ad-7f0d006cde9e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:25.289443 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-246b64b0-8681-4b48-96ad-7f0d006cde9e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:25.289920 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-246b64b0-8681-4b48-96ad-7f0d006cde9e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:25.290341 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-246b64b0-8681-4b48-96ad-7f0d006cde9e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:25.291077 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-246b64b0-8681-4b48-96ad-7f0d006cde9e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:25.291525 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-246b64b0-8681-4b48-96ad-7f0d006cde9e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:25.291958 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-246b64b0-8681-4b48-96ad-7f0d006cde9e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:25.430271 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-246b64b0-8681-4b48-96ad-7f0d006cde9e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:25.442276 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-246b64b0-8681-4b48-96ad-7f0d006cde9e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:25.444406 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-246b64b0-8681-4b48-96ad-7f0d006cde9e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:25.446099 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-246b64b0-8681-4b48-96ad-7f0d006cde9e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1739 microversion: 2.20 time: 0.167876 Oct 11 12:14:25.446969 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 553/1062] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:25 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:26.474400 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-eb2087eb-4ce0-459b-9cb7-2fc9ba7b8531 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:26.475162 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-eb2087eb-4ce0-459b-9cb7-2fc9ba7b8531 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:26.477860 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_api:SELECT=28 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:14:26.483544 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eb2087eb-4ce0-459b-9cb7-2fc9ba7b8531 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:26.484022 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eb2087eb-4ce0-459b-9cb7-2fc9ba7b8531 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:26.484450 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eb2087eb-4ce0-459b-9cb7-2fc9ba7b8531 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:26.485148 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eb2087eb-4ce0-459b-9cb7-2fc9ba7b8531 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:26.485590 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eb2087eb-4ce0-459b-9cb7-2fc9ba7b8531 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:26.485985 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eb2087eb-4ce0-459b-9cb7-2fc9ba7b8531 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:26.489008 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=82 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:14:26.627649 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-eb2087eb-4ce0-459b-9cb7-2fc9ba7b8531 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:26.636895 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-eb2087eb-4ce0-459b-9cb7-2fc9ba7b8531 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:26.638327 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-eb2087eb-4ce0-459b-9cb7-2fc9ba7b8531 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:26.639512 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-eb2087eb-4ce0-459b-9cb7-2fc9ba7b8531 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1721 microversion: 2.20 time: 0.169207 Oct 11 12:14:26.640065 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 510/1063] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:26 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:27.668997 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-107d4ce8-a4c1-4ec9-bfdd-afd8178557cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:27.669633 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-107d4ce8-a4c1-4ec9-bfdd-afd8178557cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:27.678469 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-107d4ce8-a4c1-4ec9-bfdd-afd8178557cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:27.679497 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-107d4ce8-a4c1-4ec9-bfdd-afd8178557cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:27.679497 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-107d4ce8-a4c1-4ec9-bfdd-afd8178557cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:27.680090 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-107d4ce8-a4c1-4ec9-bfdd-afd8178557cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:27.680534 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-107d4ce8-a4c1-4ec9-bfdd-afd8178557cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:27.680951 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-107d4ce8-a4c1-4ec9-bfdd-afd8178557cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:27.820606 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-107d4ce8-a4c1-4ec9-bfdd-afd8178557cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:27.831048 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-107d4ce8-a4c1-4ec9-bfdd-afd8178557cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:27.832491 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-107d4ce8-a4c1-4ec9-bfdd-afd8178557cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:27.833933 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-107d4ce8-a4c1-4ec9-bfdd-afd8178557cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1721 microversion: 2.20 time: 0.171161 Oct 11 12:14:27.847802 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 554/1064] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:27 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:28.862246 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-eae265dc-50de-4d50-820c-568e874cc78e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:28.863299 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-eae265dc-50de-4d50-820c-568e874cc78e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:28.874072 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eae265dc-50de-4d50-820c-568e874cc78e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:28.874922 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eae265dc-50de-4d50-820c-568e874cc78e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:28.875602 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eae265dc-50de-4d50-820c-568e874cc78e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:28.876751 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eae265dc-50de-4d50-820c-568e874cc78e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:28.877614 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eae265dc-50de-4d50-820c-568e874cc78e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:28.878213 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eae265dc-50de-4d50-820c-568e874cc78e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:29.015856 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-eae265dc-50de-4d50-820c-568e874cc78e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:29.024641 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-eae265dc-50de-4d50-820c-568e874cc78e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:29.026069 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-eae265dc-50de-4d50-820c-568e874cc78e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:29.027268 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-eae265dc-50de-4d50-820c-568e874cc78e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1664 microversion: 2.20 time: 0.170246 Oct 11 12:14:29.027822 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 511/1065] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:28 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1664 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:29.051909 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-294d2480-80c7-434e-937d-773e6f4528a9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4fbcb072-530a-40dd-9e3f-ab8698a95981"}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:14:29.054543 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-294d2480-80c7-434e-937d-773e6f4528a9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:29.065090 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-294d2480-80c7-434e-937d-773e6f4528a9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:29.065782 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-294d2480-80c7-434e-937d-773e6f4528a9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:29.066361 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-294d2480-80c7-434e-937d-773e6f4528a9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:29.067442 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-294d2480-80c7-434e-937d-773e6f4528a9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:29.068103 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-294d2480-80c7-434e-937d-773e6f4528a9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:29.068664 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-294d2480-80c7-434e-937d-773e6f4528a9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:29.373788 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-294d2480-80c7-434e-937d-773e6f4528a9 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "POST /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.325834 Oct 11 12:14:29.374313 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 555/1066] 10.222.0.59 () {62 vars in 1364 bytes} [Tue Oct 11 12:14:29 2022] POST /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15/os-volume_attachments => generated 188 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 12:14:29.502541 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-ae9428ba-a3b1-4d31-917e-5dbb1ee336fa tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:29.503052 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-ae9428ba-a3b1-4d31-917e-5dbb1ee336fa tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:29.509886 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ae9428ba-a3b1-4d31-917e-5dbb1ee336fa tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:29.510358 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ae9428ba-a3b1-4d31-917e-5dbb1ee336fa tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:29.510838 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ae9428ba-a3b1-4d31-917e-5dbb1ee336fa tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:29.511521 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ae9428ba-a3b1-4d31-917e-5dbb1ee336fa tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:29.511983 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ae9428ba-a3b1-4d31-917e-5dbb1ee336fa tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:29.512398 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ae9428ba-a3b1-4d31-917e-5dbb1ee336fa tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:29.567346 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-cee8213e-253d-4e57-9173-999d540f7a89 req-9f7ffd44-07b5-4136-b9e6-c3e864b53dbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f7ef566-fc3f-4b87-96a7-2d2a650a4d15", "name": "network-vif-unplugged", "status": "completed", "tag": "587860e6-e550-42be-bb20-fe198f47ec93"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:14:29.579241 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-cee8213e-253d-4e57-9173-999d540f7a89 req-9f7ffd44-07b5-4136-b9e6-c3e864b53dbe service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:29.580164 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-cee8213e-253d-4e57-9173-999d540f7a89 req-9f7ffd44-07b5-4136-b9e6-c3e864b53dbe service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:29.580764 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-cee8213e-253d-4e57-9173-999d540f7a89 req-9f7ffd44-07b5-4136-b9e6-c3e864b53dbe service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:29.592724 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.compute.server_external_events [req-cee8213e-253d-4e57-9173-999d540f7a89 req-9f7ffd44-07b5-4136-b9e6-c3e864b53dbe service nova] Unable to find a host for instance 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15. Dropping event network-vif-unplugged {{(pid=118995) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 11 12:14:29.593620 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-cee8213e-253d-4e57-9173-999d540f7a89 req-9f7ffd44-07b5-4136-b9e6-c3e864b53dbe service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031039 Oct 11 12:14:29.594205 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 556/1067] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 11 12:14:29.765499 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-ae9428ba-a3b1-4d31-917e-5dbb1ee336fa tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15/os-volume_attachments/4fbcb072-530a-40dd-9e3f-ab8698a95981" status: 202 len: 0 microversion: 2.20 time: 0.266591 Oct 11 12:14:29.766081 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 512/1068] 10.222.0.59 () {60 vars in 1457 bytes} [Tue Oct 11 12:14:29 2022] DELETE /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15/os-volume_attachments/4fbcb072-530a-40dd-9e3f-ab8698a95981 => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 12:14:29.828638 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-717bd459-1823-4c6e-93ee-8c3e417e1fb7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:14:29.829219 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-717bd459-1823-4c6e-93ee-8c3e417e1fb7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:29.835258 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-717bd459-1823-4c6e-93ee-8c3e417e1fb7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:29.835734 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-717bd459-1823-4c6e-93ee-8c3e417e1fb7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:29.836156 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-717bd459-1823-4c6e-93ee-8c3e417e1fb7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:29.836829 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-717bd459-1823-4c6e-93ee-8c3e417e1fb7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:29.837275 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-717bd459-1823-4c6e-93ee-8c3e417e1fb7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:29.837687 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-717bd459-1823-4c6e-93ee-8c3e417e1fb7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:29.866498 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-717bd459-1823-4c6e-93ee-8c3e417e1fb7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118995) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 11 12:14:29.939528 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-717bd459-1823-4c6e-93ee-8c3e417e1fb7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "POST /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15/action" status: 202 len: 0 microversion: 2.20 time: 0.114776 Oct 11 12:14:29.940038 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 557/1069] 10.222.0.59 () {62 vars in 1319 bytes} [Tue Oct 11 12:14:29 2022] POST /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 11 12:14:29.948516 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-911ae023-840d-4c77-89e2-5eacb1ae9a80 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:29.949890 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-911ae023-840d-4c77-89e2-5eacb1ae9a80 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:29.957403 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-911ae023-840d-4c77-89e2-5eacb1ae9a80 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:29.957869 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-911ae023-840d-4c77-89e2-5eacb1ae9a80 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:29.958481 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-911ae023-840d-4c77-89e2-5eacb1ae9a80 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:29.959552 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-911ae023-840d-4c77-89e2-5eacb1ae9a80 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:29.960225 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-911ae023-840d-4c77-89e2-5eacb1ae9a80 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:29.960931 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-911ae023-840d-4c77-89e2-5eacb1ae9a80 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:30.095262 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-911ae023-840d-4c77-89e2-5eacb1ae9a80 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:30.104043 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-911ae023-840d-4c77-89e2-5eacb1ae9a80 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:30.105485 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-911ae023-840d-4c77-89e2-5eacb1ae9a80 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:30.106702 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-911ae023-840d-4c77-89e2-5eacb1ae9a80 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1672 microversion: 2.20 time: 0.162296 Oct 11 12:14:30.107290 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 513/1070] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:29 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1672 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 12:14:31.133309 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-deaf1d8a-3f76-488e-8bf9-3215696a58fa tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:31.133962 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-deaf1d8a-3f76-488e-8bf9-3215696a58fa tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:31.140197 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-deaf1d8a-3f76-488e-8bf9-3215696a58fa tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:31.140672 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-deaf1d8a-3f76-488e-8bf9-3215696a58fa tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:31.141097 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-deaf1d8a-3f76-488e-8bf9-3215696a58fa tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:31.141780 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-deaf1d8a-3f76-488e-8bf9-3215696a58fa tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:31.142228 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-deaf1d8a-3f76-488e-8bf9-3215696a58fa tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:31.142648 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-deaf1d8a-3f76-488e-8bf9-3215696a58fa tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:31.281721 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-deaf1d8a-3f76-488e-8bf9-3215696a58fa tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:31.290773 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-deaf1d8a-3f76-488e-8bf9-3215696a58fa tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:31.292209 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-deaf1d8a-3f76-488e-8bf9-3215696a58fa tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:31.293378 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-deaf1d8a-3f76-488e-8bf9-3215696a58fa tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1672 microversion: 2.20 time: 0.164774 Oct 11 12:14:31.293974 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 558/1071] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:31 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:32.318968 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-353f0818-ec75-4415-a2e3-142b7cb92670 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:32.319587 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-353f0818-ec75-4415-a2e3-142b7cb92670 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:32.326501 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-353f0818-ec75-4415-a2e3-142b7cb92670 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:32.327024 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-353f0818-ec75-4415-a2e3-142b7cb92670 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:32.327463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-353f0818-ec75-4415-a2e3-142b7cb92670 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:32.328154 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-353f0818-ec75-4415-a2e3-142b7cb92670 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:32.328577 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-353f0818-ec75-4415-a2e3-142b7cb92670 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:32.329026 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-353f0818-ec75-4415-a2e3-142b7cb92670 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:32.463866 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-353f0818-ec75-4415-a2e3-142b7cb92670 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:32.472351 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-353f0818-ec75-4415-a2e3-142b7cb92670 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:32.473784 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-353f0818-ec75-4415-a2e3-142b7cb92670 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:32.475075 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-353f0818-ec75-4415-a2e3-142b7cb92670 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1672 microversion: 2.20 time: 0.160266 Oct 11 12:14:32.475646 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 514/1072] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:32 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1672 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:33.500388 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-784f7eeb-91d4-41f8-84f8-c88e642bf0cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:33.500977 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-784f7eeb-91d4-41f8-84f8-c88e642bf0cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:33.507986 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-784f7eeb-91d4-41f8-84f8-c88e642bf0cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:33.508468 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-784f7eeb-91d4-41f8-84f8-c88e642bf0cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:33.508900 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-784f7eeb-91d4-41f8-84f8-c88e642bf0cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:33.509580 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-784f7eeb-91d4-41f8-84f8-c88e642bf0cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:33.510034 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-784f7eeb-91d4-41f8-84f8-c88e642bf0cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:33.510444 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-784f7eeb-91d4-41f8-84f8-c88e642bf0cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:33.651777 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-784f7eeb-91d4-41f8-84f8-c88e642bf0cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:33.660531 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-784f7eeb-91d4-41f8-84f8-c88e642bf0cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:33.661954 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-784f7eeb-91d4-41f8-84f8-c88e642bf0cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:33.663195 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-784f7eeb-91d4-41f8-84f8-c88e642bf0cd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1672 microversion: 2.20 time: 0.166874 Oct 11 12:14:33.663750 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 559/1073] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:33 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1672 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:34.689571 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-26f0ec4f-0eda-4018-a53f-5c18fd675cea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:34.690172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-26f0ec4f-0eda-4018-a53f-5c18fd675cea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:34.698334 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-26f0ec4f-0eda-4018-a53f-5c18fd675cea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:34.698962 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-26f0ec4f-0eda-4018-a53f-5c18fd675cea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:34.699375 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-26f0ec4f-0eda-4018-a53f-5c18fd675cea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:34.700073 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-26f0ec4f-0eda-4018-a53f-5c18fd675cea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:34.700513 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-26f0ec4f-0eda-4018-a53f-5c18fd675cea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:34.700932 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-26f0ec4f-0eda-4018-a53f-5c18fd675cea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:34.841498 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-26f0ec4f-0eda-4018-a53f-5c18fd675cea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:34.850160 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-26f0ec4f-0eda-4018-a53f-5c18fd675cea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:34.851951 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-26f0ec4f-0eda-4018-a53f-5c18fd675cea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:34.853339 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-26f0ec4f-0eda-4018-a53f-5c18fd675cea tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1730 microversion: 2.20 time: 0.168164 Oct 11 12:14:34.853910 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 515/1074] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:34 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:35.879037 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-cf7cf521-bf1c-47e0-a560-7219c9315018 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:35.879738 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-cf7cf521-bf1c-47e0-a560-7219c9315018 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:35.886393 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cf7cf521-bf1c-47e0-a560-7219c9315018 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:35.888148 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cf7cf521-bf1c-47e0-a560-7219c9315018 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:35.888583 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cf7cf521-bf1c-47e0-a560-7219c9315018 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:35.889373 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cf7cf521-bf1c-47e0-a560-7219c9315018 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:35.889800 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cf7cf521-bf1c-47e0-a560-7219c9315018 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:35.890255 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-cf7cf521-bf1c-47e0-a560-7219c9315018 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:36.051016 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-cf7cf521-bf1c-47e0-a560-7219c9315018 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:36.060692 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-cf7cf521-bf1c-47e0-a560-7219c9315018 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:36.062167 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-cf7cf521-bf1c-47e0-a560-7219c9315018 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:36.063365 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-cf7cf521-bf1c-47e0-a560-7219c9315018 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1730 microversion: 2.20 time: 0.188295 Oct 11 12:14:36.074655 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 560/1075] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:35 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1730 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:37.089803 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-cf5bc6d6-a041-459a-9beb-02864dfc7656 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:37.090411 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-cf5bc6d6-a041-459a-9beb-02864dfc7656 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:37.097592 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cf5bc6d6-a041-459a-9beb-02864dfc7656 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:37.098071 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cf5bc6d6-a041-459a-9beb-02864dfc7656 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:37.098501 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cf5bc6d6-a041-459a-9beb-02864dfc7656 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:37.099199 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cf5bc6d6-a041-459a-9beb-02864dfc7656 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:37.100145 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cf5bc6d6-a041-459a-9beb-02864dfc7656 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:37.100571 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cf5bc6d6-a041-459a-9beb-02864dfc7656 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:37.242975 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-cf5bc6d6-a041-459a-9beb-02864dfc7656 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:37.251936 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-cf5bc6d6-a041-459a-9beb-02864dfc7656 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:37.253461 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-cf5bc6d6-a041-459a-9beb-02864dfc7656 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:37.254748 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-cf5bc6d6-a041-459a-9beb-02864dfc7656 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1730 microversion: 2.20 time: 0.169077 Oct 11 12:14:37.255314 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 516/1076] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:37 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:38.281695 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-0ab2e5ab-e279-4997-b160-c512bb3f7207 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:38.282395 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-0ab2e5ab-e279-4997-b160-c512bb3f7207 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:38.288939 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0ab2e5ab-e279-4997-b160-c512bb3f7207 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:38.289439 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0ab2e5ab-e279-4997-b160-c512bb3f7207 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:38.289872 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0ab2e5ab-e279-4997-b160-c512bb3f7207 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:38.290601 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0ab2e5ab-e279-4997-b160-c512bb3f7207 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:38.291041 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0ab2e5ab-e279-4997-b160-c512bb3f7207 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:38.291459 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-0ab2e5ab-e279-4997-b160-c512bb3f7207 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:38.430251 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0ab2e5ab-e279-4997-b160-c512bb3f7207 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:38.439371 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0ab2e5ab-e279-4997-b160-c512bb3f7207 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:38.440788 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-0ab2e5ab-e279-4997-b160-c512bb3f7207 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:38.441988 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-0ab2e5ab-e279-4997-b160-c512bb3f7207 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1730 microversion: 2.20 time: 0.164408 Oct 11 12:14:38.443596 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 561/1077] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:38 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:39.467582 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-800e9043-a387-48cf-9450-27de00055507 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:39.468276 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-800e9043-a387-48cf-9450-27de00055507 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:39.475313 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-800e9043-a387-48cf-9450-27de00055507 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:39.475795 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-800e9043-a387-48cf-9450-27de00055507 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:39.476230 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-800e9043-a387-48cf-9450-27de00055507 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:39.476895 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-800e9043-a387-48cf-9450-27de00055507 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:39.477362 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-800e9043-a387-48cf-9450-27de00055507 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:39.477772 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-800e9043-a387-48cf-9450-27de00055507 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:39.618408 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-800e9043-a387-48cf-9450-27de00055507 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:39.629383 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-800e9043-a387-48cf-9450-27de00055507 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:39.630856 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-800e9043-a387-48cf-9450-27de00055507 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:39.632211 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-800e9043-a387-48cf-9450-27de00055507 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1730 microversion: 2.20 time: 0.168588 Oct 11 12:14:39.633198 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 517/1078] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:39 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:40.658098 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-feb0c4a1-c47b-485f-8472-111977323f17 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:40.658788 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-feb0c4a1-c47b-485f-8472-111977323f17 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:40.667317 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-feb0c4a1-c47b-485f-8472-111977323f17 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:40.667839 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-feb0c4a1-c47b-485f-8472-111977323f17 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:40.668263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-feb0c4a1-c47b-485f-8472-111977323f17 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:40.668982 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-feb0c4a1-c47b-485f-8472-111977323f17 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:40.669597 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-feb0c4a1-c47b-485f-8472-111977323f17 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:40.670018 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-feb0c4a1-c47b-485f-8472-111977323f17 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:40.813140 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-feb0c4a1-c47b-485f-8472-111977323f17 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:40.824430 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-feb0c4a1-c47b-485f-8472-111977323f17 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:40.825942 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-feb0c4a1-c47b-485f-8472-111977323f17 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:40.827193 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-feb0c4a1-c47b-485f-8472-111977323f17 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1730 microversion: 2.20 time: 0.173237 Oct 11 12:14:40.828179 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 562/1079] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:40 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1730 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:41.852964 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-2bb57b29-862e-4cbc-b77f-168f17237e04 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:41.853758 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-2bb57b29-862e-4cbc-b77f-168f17237e04 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:41.860712 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2bb57b29-862e-4cbc-b77f-168f17237e04 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:41.861201 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2bb57b29-862e-4cbc-b77f-168f17237e04 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:41.861633 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2bb57b29-862e-4cbc-b77f-168f17237e04 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:41.862345 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2bb57b29-862e-4cbc-b77f-168f17237e04 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:41.862833 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2bb57b29-862e-4cbc-b77f-168f17237e04 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:41.863263 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-2bb57b29-862e-4cbc-b77f-168f17237e04 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:42.003195 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-2bb57b29-862e-4cbc-b77f-168f17237e04 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:42.012114 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-2bb57b29-862e-4cbc-b77f-168f17237e04 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:42.013631 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-2bb57b29-862e-4cbc-b77f-168f17237e04 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:42.014788 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-2bb57b29-862e-4cbc-b77f-168f17237e04 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1730 microversion: 2.20 time: 0.166072 Oct 11 12:14:42.015604 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 518/1080] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:41 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:43.040816 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-5b637d83-b79b-4009-bee1-92445b03e760 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:43.041469 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-5b637d83-b79b-4009-bee1-92445b03e760 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:43.048477 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5b637d83-b79b-4009-bee1-92445b03e760 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:43.048957 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5b637d83-b79b-4009-bee1-92445b03e760 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:43.049379 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5b637d83-b79b-4009-bee1-92445b03e760 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:43.050070 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5b637d83-b79b-4009-bee1-92445b03e760 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:43.050494 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5b637d83-b79b-4009-bee1-92445b03e760 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:43.050953 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-5b637d83-b79b-4009-bee1-92445b03e760 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:43.194495 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5b637d83-b79b-4009-bee1-92445b03e760 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:43.205350 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5b637d83-b79b-4009-bee1-92445b03e760 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:43.207088 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-5b637d83-b79b-4009-bee1-92445b03e760 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:43.208316 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-5b637d83-b79b-4009-bee1-92445b03e760 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1730 microversion: 2.20 time: 0.171698 Oct 11 12:14:43.209165 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 563/1081] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:43 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:44.234579 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-40522f59-2d2e-4445-9c0b-63239fd8c2c7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:44.235299 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-40522f59-2d2e-4445-9c0b-63239fd8c2c7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:44.243875 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-40522f59-2d2e-4445-9c0b-63239fd8c2c7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:44.244367 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-40522f59-2d2e-4445-9c0b-63239fd8c2c7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:44.244774 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-40522f59-2d2e-4445-9c0b-63239fd8c2c7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:44.245476 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-40522f59-2d2e-4445-9c0b-63239fd8c2c7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:44.245925 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-40522f59-2d2e-4445-9c0b-63239fd8c2c7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:44.246344 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-40522f59-2d2e-4445-9c0b-63239fd8c2c7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:44.393299 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-40522f59-2d2e-4445-9c0b-63239fd8c2c7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:44.402758 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-40522f59-2d2e-4445-9c0b-63239fd8c2c7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:44.404214 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-40522f59-2d2e-4445-9c0b-63239fd8c2c7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:44.405477 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-40522f59-2d2e-4445-9c0b-63239fd8c2c7 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1730 microversion: 2.20 time: 0.175740 Oct 11 12:14:44.406336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 519/1082] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:44 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:45.430780 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-909a1b76-afbd-4e41-8f22-01eb320038b3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:45.431420 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-909a1b76-afbd-4e41-8f22-01eb320038b3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:45.438587 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-909a1b76-afbd-4e41-8f22-01eb320038b3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:45.439078 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-909a1b76-afbd-4e41-8f22-01eb320038b3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:45.439541 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-909a1b76-afbd-4e41-8f22-01eb320038b3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:45.440374 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-909a1b76-afbd-4e41-8f22-01eb320038b3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:45.440963 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-909a1b76-afbd-4e41-8f22-01eb320038b3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:45.441501 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-909a1b76-afbd-4e41-8f22-01eb320038b3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:45.588607 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-909a1b76-afbd-4e41-8f22-01eb320038b3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:45.600913 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-909a1b76-afbd-4e41-8f22-01eb320038b3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:45.602335 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-909a1b76-afbd-4e41-8f22-01eb320038b3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:45.603517 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-909a1b76-afbd-4e41-8f22-01eb320038b3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1730 microversion: 2.20 time: 0.176792 Oct 11 12:14:45.604088 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 564/1083] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:45 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:46.629854 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-734a27d6-dd9d-4bd1-9c84-bb826a9e709f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:46.630472 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-734a27d6-dd9d-4bd1-9c84-bb826a9e709f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:46.639338 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-734a27d6-dd9d-4bd1-9c84-bb826a9e709f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:46.640143 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-734a27d6-dd9d-4bd1-9c84-bb826a9e709f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:46.640856 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-734a27d6-dd9d-4bd1-9c84-bb826a9e709f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:46.641996 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-734a27d6-dd9d-4bd1-9c84-bb826a9e709f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:46.642793 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-734a27d6-dd9d-4bd1-9c84-bb826a9e709f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:46.643495 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-734a27d6-dd9d-4bd1-9c84-bb826a9e709f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:46.777010 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-734a27d6-dd9d-4bd1-9c84-bb826a9e709f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:46.785282 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-734a27d6-dd9d-4bd1-9c84-bb826a9e709f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:46.786764 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-734a27d6-dd9d-4bd1-9c84-bb826a9e709f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:46.787921 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-734a27d6-dd9d-4bd1-9c84-bb826a9e709f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1730 microversion: 2.20 time: 0.162749 Oct 11 12:14:46.788523 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 520/1084] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:46 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 12:14:47.813586 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c1d162c7-5137-48f7-8501-49a5b3087233 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:47.814175 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c1d162c7-5137-48f7-8501-49a5b3087233 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:47.821240 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c1d162c7-5137-48f7-8501-49a5b3087233 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:47.821713 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c1d162c7-5137-48f7-8501-49a5b3087233 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:47.822135 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c1d162c7-5137-48f7-8501-49a5b3087233 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:47.822848 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c1d162c7-5137-48f7-8501-49a5b3087233 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:47.823285 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c1d162c7-5137-48f7-8501-49a5b3087233 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:47.823703 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c1d162c7-5137-48f7-8501-49a5b3087233 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:47.969989 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c1d162c7-5137-48f7-8501-49a5b3087233 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:47.972223 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:14:47.979652 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c1d162c7-5137-48f7-8501-49a5b3087233 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:47.981078 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-c1d162c7-5137-48f7-8501-49a5b3087233 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:47.982241 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c1d162c7-5137-48f7-8501-49a5b3087233 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1730 microversion: 2.20 time: 0.172654 Oct 11 12:14:47.982833 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 565/1085] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:47 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:49.008232 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-236f12b6-6327-4698-9fef-95b64049908e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:49.008828 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-236f12b6-6327-4698-9fef-95b64049908e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:49.015684 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-236f12b6-6327-4698-9fef-95b64049908e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:49.016166 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-236f12b6-6327-4698-9fef-95b64049908e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:49.016600 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-236f12b6-6327-4698-9fef-95b64049908e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:49.017290 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-236f12b6-6327-4698-9fef-95b64049908e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:49.017740 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-236f12b6-6327-4698-9fef-95b64049908e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:49.018224 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-236f12b6-6327-4698-9fef-95b64049908e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:49.406493 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-236f12b6-6327-4698-9fef-95b64049908e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:49.414946 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-236f12b6-6327-4698-9fef-95b64049908e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:49.416364 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-236f12b6-6327-4698-9fef-95b64049908e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:49.417547 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-236f12b6-6327-4698-9fef-95b64049908e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1730 microversion: 2.20 time: 0.413582 Oct 11 12:14:49.418103 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 521/1086] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:49 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1730 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:50.443887 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-1e2a8187-a394-48b5-8348-d1479a25f206 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:50.444495 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-1e2a8187-a394-48b5-8348-d1479a25f206 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:50.451475 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1e2a8187-a394-48b5-8348-d1479a25f206 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:50.451947 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1e2a8187-a394-48b5-8348-d1479a25f206 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:50.452369 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1e2a8187-a394-48b5-8348-d1479a25f206 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:50.453050 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1e2a8187-a394-48b5-8348-d1479a25f206 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:50.453492 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1e2a8187-a394-48b5-8348-d1479a25f206 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:50.453936 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-1e2a8187-a394-48b5-8348-d1479a25f206 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:50.597506 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-1e2a8187-a394-48b5-8348-d1479a25f206 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:50.606218 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-1e2a8187-a394-48b5-8348-d1479a25f206 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:50.607726 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-1e2a8187-a394-48b5-8348-d1479a25f206 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:50.608884 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-1e2a8187-a394-48b5-8348-d1479a25f206 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1730 microversion: 2.20 time: 0.169950 Oct 11 12:14:50.609476 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 566/1087] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:50 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:51.638689 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-e6e7600b-69b0-448d-afca-5f65a212af0e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:51.639565 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-e6e7600b-69b0-448d-afca-5f65a212af0e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:51.649547 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e6e7600b-69b0-448d-afca-5f65a212af0e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:51.650020 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e6e7600b-69b0-448d-afca-5f65a212af0e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:51.650462 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e6e7600b-69b0-448d-afca-5f65a212af0e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:51.651416 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e6e7600b-69b0-448d-afca-5f65a212af0e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:51.651865 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e6e7600b-69b0-448d-afca-5f65a212af0e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:51.652282 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-e6e7600b-69b0-448d-afca-5f65a212af0e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:51.785600 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-e6e7600b-69b0-448d-afca-5f65a212af0e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:51.794606 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-e6e7600b-69b0-448d-afca-5f65a212af0e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:51.796144 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-e6e7600b-69b0-448d-afca-5f65a212af0e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:51.797562 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-e6e7600b-69b0-448d-afca-5f65a212af0e tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1730 microversion: 2.20 time: 0.165684 Oct 11 12:14:51.798028 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 522/1088] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:51 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:52.824033 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2501c7fa-5093-4816-acfe-806c2cc64bfd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:52.824708 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2501c7fa-5093-4816-acfe-806c2cc64bfd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:52.831836 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2501c7fa-5093-4816-acfe-806c2cc64bfd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:52.832324 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2501c7fa-5093-4816-acfe-806c2cc64bfd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:52.832749 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2501c7fa-5093-4816-acfe-806c2cc64bfd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:52.833449 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2501c7fa-5093-4816-acfe-806c2cc64bfd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:52.833899 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2501c7fa-5093-4816-acfe-806c2cc64bfd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:52.834318 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2501c7fa-5093-4816-acfe-806c2cc64bfd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:52.974926 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2501c7fa-5093-4816-acfe-806c2cc64bfd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:52.984136 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2501c7fa-5093-4816-acfe-806c2cc64bfd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:52.985315 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2501c7fa-5093-4816-acfe-806c2cc64bfd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:52.986147 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2501c7fa-5093-4816-acfe-806c2cc64bfd tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1730 microversion: 2.20 time: 0.166201 Oct 11 12:14:52.986747 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 567/1089] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:52 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:54.012815 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-a980ce5c-d825-41cd-ad88-253019b0b0ee tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:54.013408 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-a980ce5c-d825-41cd-ad88-253019b0b0ee tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:54.021045 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a980ce5c-d825-41cd-ad88-253019b0b0ee tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:54.021519 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a980ce5c-d825-41cd-ad88-253019b0b0ee tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:54.021944 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a980ce5c-d825-41cd-ad88-253019b0b0ee tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:54.022660 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a980ce5c-d825-41cd-ad88-253019b0b0ee tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:54.023108 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a980ce5c-d825-41cd-ad88-253019b0b0ee tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:54.023640 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a980ce5c-d825-41cd-ad88-253019b0b0ee tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:54.162211 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-a980ce5c-d825-41cd-ad88-253019b0b0ee tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:54.174625 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-a980ce5c-d825-41cd-ad88-253019b0b0ee tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:54.176746 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-a980ce5c-d825-41cd-ad88-253019b0b0ee tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:54.178359 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-a980ce5c-d825-41cd-ad88-253019b0b0ee tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1730 microversion: 2.20 time: 0.169550 Oct 11 12:14:54.179206 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 523/1090] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:54 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:55.203969 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-69624971-d32e-4703-8b4b-c94415c3b0b4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:55.204583 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-69624971-d32e-4703-8b4b-c94415c3b0b4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:55.207206 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:14:55.213881 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69624971-d32e-4703-8b4b-c94415c3b0b4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:55.214623 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69624971-d32e-4703-8b4b-c94415c3b0b4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:55.215117 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69624971-d32e-4703-8b4b-c94415c3b0b4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:55.216047 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69624971-d32e-4703-8b4b-c94415c3b0b4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:55.216685 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69624971-d32e-4703-8b4b-c94415c3b0b4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:55.217165 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-69624971-d32e-4703-8b4b-c94415c3b0b4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:55.355352 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-69624971-d32e-4703-8b4b-c94415c3b0b4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:55.364318 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-69624971-d32e-4703-8b4b-c94415c3b0b4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:55.365748 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-69624971-d32e-4703-8b4b-c94415c3b0b4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:55.366960 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-69624971-d32e-4703-8b4b-c94415c3b0b4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1730 microversion: 2.20 time: 0.167029 Oct 11 12:14:55.367522 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 568/1091] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:55 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:55.687750 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-d38d592a-6880-4097-a24a-d628105c52e8 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1242537367"}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:14:55.688378 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-d38d592a-6880-4097-a24a-d628105c52e8 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:55.695947 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d38d592a-6880-4097-a24a-d628105c52e8 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:55.696617 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d38d592a-6880-4097-a24a-d628105c52e8 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:55.697381 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d38d592a-6880-4097-a24a-d628105c52e8 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:55.698537 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d38d592a-6880-4097-a24a-d628105c52e8 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:55.698979 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d38d592a-6880-4097-a24a-d628105c52e8 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:55.699421 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d38d592a-6880-4097-a24a-d628105c52e8 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:55.703886 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:14:55.797619 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-6fe09dcb-a4ac-4ba2-9af5-6e45ca0021ac req-26aba2ea-22f4-4d95-9e4b-bc20676663ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f7ef566-fc3f-4b87-96a7-2d2a650a4d15", "name": "network-vif-plugged", "status": "completed", "tag": "587860e6-e550-42be-bb20-fe198f47ec93"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:14:55.809429 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-6fe09dcb-a4ac-4ba2-9af5-6e45ca0021ac req-26aba2ea-22f4-4d95-9e4b-bc20676663ed service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:55.809429 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-6fe09dcb-a4ac-4ba2-9af5-6e45ca0021ac req-26aba2ea-22f4-4d95-9e4b-bc20676663ed service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:55.809832 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-6fe09dcb-a4ac-4ba2-9af5-6e45ca0021ac req-26aba2ea-22f4-4d95-9e4b-bc20676663ed service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:55.822090 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-6fe09dcb-a4ac-4ba2-9af5-6e45ca0021ac req-26aba2ea-22f4-4d95-9e4b-bc20676663ed service nova] Creating event network-vif-plugged:587860e6-e550-42be-bb20-fe198f47ec93 for instance 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 on hv-cinder-82099 Oct 11 12:14:55.827264 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-6fe09dcb-a4ac-4ba2-9af5-6e45ca0021ac req-26aba2ea-22f4-4d95-9e4b-bc20676663ed service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033723 Oct 11 12:14:55.828038 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 569/1092] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:14:55.891649 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.network.security_group_api [None req-d38d592a-6880-4097-a24a-d628105c52e8 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Removing security group 2964b4e6-ffd1-4ec9-aa2a-ffa0d39072da from port 91b90de7-e871-422f-a2ac-9331cb77b634 Oct 11 12:14:56.224824 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-d38d592a-6880-4097-a24a-d628105c52e8 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "POST /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac/action" status: 202 len: 0 microversion: 2.1 time: 0.542432 Oct 11 12:14:56.225487 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 524/1093] 10.222.0.59 () {60 vars in 1278 bytes} [Tue Oct 11 12:14:55 2022] POST /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac/action => generated 0 bytes in 544 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 12:14:56.234157 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-bf3cf0e2-7b79-4b79-8314-bbda45be252c req-6bb5f5cc-ecb5-4107-ad73-d0e2d9f33c6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fa95338-071a-4ea3-9562-c37c74c182ac", "tag": "91b90de7-e871-422f-a2ac-9331cb77b634"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:14:56.244981 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-bf3cf0e2-7b79-4b79-8314-bbda45be252c req-6bb5f5cc-ecb5-4107-ad73-d0e2d9f33c6e service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:56.245454 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-bf3cf0e2-7b79-4b79-8314-bbda45be252c req-6bb5f5cc-ecb5-4107-ad73-d0e2d9f33c6e service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:56.245880 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-bf3cf0e2-7b79-4b79-8314-bbda45be252c req-6bb5f5cc-ecb5-4107-ad73-d0e2d9f33c6e service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:56.264761 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-bf3cf0e2-7b79-4b79-8314-bbda45be252c req-6bb5f5cc-ecb5-4107-ad73-d0e2d9f33c6e service nova] Creating event network-changed:91b90de7-e871-422f-a2ac-9331cb77b634 for instance 2fa95338-071a-4ea3-9562-c37c74c182ac on hv-cinder-82099 Oct 11 12:14:56.270075 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-bf3cf0e2-7b79-4b79-8314-bbda45be252c req-6bb5f5cc-ecb5-4107-ad73-d0e2d9f33c6e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039949 Oct 11 12:14:56.270742 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 570/1094] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:14:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:14:56.392217 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-9a8c7194-2480-4942-8bd9-feff7d15fec6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:56.393209 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-9a8c7194-2480-4942-8bd9-feff7d15fec6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:56.400124 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9a8c7194-2480-4942-8bd9-feff7d15fec6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:56.400939 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9a8c7194-2480-4942-8bd9-feff7d15fec6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:56.401611 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9a8c7194-2480-4942-8bd9-feff7d15fec6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:56.402383 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9a8c7194-2480-4942-8bd9-feff7d15fec6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:56.403035 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9a8c7194-2480-4942-8bd9-feff7d15fec6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:56.403665 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9a8c7194-2480-4942-8bd9-feff7d15fec6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:56.579837 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-9a8c7194-2480-4942-8bd9-feff7d15fec6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:56.588255 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-9a8c7194-2480-4942-8bd9-feff7d15fec6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:56.589727 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-9a8c7194-2480-4942-8bd9-feff7d15fec6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:56.590924 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-9a8c7194-2480-4942-8bd9-feff7d15fec6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1730 microversion: 2.20 time: 0.202662 Oct 11 12:14:56.591688 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 525/1095] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:56 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1730 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:57.618026 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-90f6f6e2-45a0-4a9a-985a-072967f616a4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:57.618738 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-90f6f6e2-45a0-4a9a-985a-072967f616a4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:57.625229 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-90f6f6e2-45a0-4a9a-985a-072967f616a4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:57.625704 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-90f6f6e2-45a0-4a9a-985a-072967f616a4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:57.626126 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-90f6f6e2-45a0-4a9a-985a-072967f616a4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:57.626843 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-90f6f6e2-45a0-4a9a-985a-072967f616a4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:57.627282 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-90f6f6e2-45a0-4a9a-985a-072967f616a4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:57.627692 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-90f6f6e2-45a0-4a9a-985a-072967f616a4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:57.826744 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-6e618648-93f0-4adb-a1d5-d1af76583e30 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:57.827820 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-6e618648-93f0-4adb-a1d5-d1af76583e30 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:57.830322 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_api:SELECT=32 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:14:57.837166 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6e618648-93f0-4adb-a1d5-d1af76583e30 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:57.838152 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6e618648-93f0-4adb-a1d5-d1af76583e30 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:57.838814 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6e618648-93f0-4adb-a1d5-d1af76583e30 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:57.839828 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6e618648-93f0-4adb-a1d5-d1af76583e30 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:57.840266 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6e618648-93f0-4adb-a1d5-d1af76583e30 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:57.840856 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-6e618648-93f0-4adb-a1d5-d1af76583e30 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:57.866425 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-90f6f6e2-45a0-4a9a-985a-072967f616a4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:57.877223 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-90f6f6e2-45a0-4a9a-985a-072967f616a4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:57.878934 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-90f6f6e2-45a0-4a9a-985a-072967f616a4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:57.880854 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-90f6f6e2-45a0-4a9a-985a-072967f616a4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1730 microversion: 2.20 time: 0.266921 Oct 11 12:14:57.891114 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 571/1096] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:57 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1730 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:57.898103 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-4cf2de09-9723-4537-b8af-df26762f8617 req-ad0d2006-6899-4dd3-ade2-15a9c8e442fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2fa95338-071a-4ea3-9562-c37c74c182ac", "tag": "91b90de7-e871-422f-a2ac-9331cb77b634"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:14:57.909858 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-4cf2de09-9723-4537-b8af-df26762f8617 req-ad0d2006-6899-4dd3-ade2-15a9c8e442fa service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:57.910446 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-4cf2de09-9723-4537-b8af-df26762f8617 req-ad0d2006-6899-4dd3-ade2-15a9c8e442fa service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:57.910996 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-4cf2de09-9723-4537-b8af-df26762f8617 req-ad0d2006-6899-4dd3-ade2-15a9c8e442fa service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:57.928848 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-4cf2de09-9723-4537-b8af-df26762f8617 req-ad0d2006-6899-4dd3-ade2-15a9c8e442fa service nova] Creating event network-changed:91b90de7-e871-422f-a2ac-9331cb77b634 for instance 2fa95338-071a-4ea3-9562-c37c74c182ac on hv-cinder-82099 Oct 11 12:14:57.930031 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.objects.instance [None req-6e618648-93f0-4adb-a1d5-d1af76583e30 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lazy-loading 'services' on Instance uuid 2fa95338-071a-4ea3-9562-c37c74c182ac {{(pid=118994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:14:57.934791 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-4cf2de09-9723-4537-b8af-df26762f8617 req-ad0d2006-6899-4dd3-ade2-15a9c8e442fa service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041857 Oct 11 12:14:57.935607 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 572/1097] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:14:58.029364 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-6e618648-93f0-4adb-a1d5-d1af76583e30 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac/os-volume_attachments/7aa99961-c1de-4c52-b629-0fb5efd1f448" status: 202 len: 0 microversion: 2.1 time: 0.205861 Oct 11 12:14:58.031228 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 526/1098] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Oct 11 12:14:57 2022] DELETE /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac/os-volume_attachments/7aa99961-c1de-4c52-b629-0fb5efd1f448 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 12:14:58.040891 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-c4d1da09-8888-42c1-a520-d94ebd47c905 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:58.043569 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-c4d1da09-8888-42c1-a520-d94ebd47c905 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:58.051235 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c4d1da09-8888-42c1-a520-d94ebd47c905 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:58.051860 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c4d1da09-8888-42c1-a520-d94ebd47c905 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:58.052404 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c4d1da09-8888-42c1-a520-d94ebd47c905 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:58.053224 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c4d1da09-8888-42c1-a520-d94ebd47c905 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:58.053788 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c4d1da09-8888-42c1-a520-d94ebd47c905 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:58.054304 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-c4d1da09-8888-42c1-a520-d94ebd47c905 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:58.110252 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-c4d1da09-8888-42c1-a520-d94ebd47c905 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074142 Oct 11 12:14:58.116063 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 573/1099] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Oct 11 12:14:58 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:14:58.910929 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-34ce1e1b-eed2-41b5-a12c-7a4e138364f3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:58.911816 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-34ce1e1b-eed2-41b5-a12c-7a4e138364f3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:58.920094 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-34ce1e1b-eed2-41b5-a12c-7a4e138364f3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:58.920700 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-34ce1e1b-eed2-41b5-a12c-7a4e138364f3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:58.921148 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-34ce1e1b-eed2-41b5-a12c-7a4e138364f3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:58.921985 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-34ce1e1b-eed2-41b5-a12c-7a4e138364f3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:58.922748 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-34ce1e1b-eed2-41b5-a12c-7a4e138364f3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:58.923390 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-34ce1e1b-eed2-41b5-a12c-7a4e138364f3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:59.079225 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-34ce1e1b-eed2-41b5-a12c-7a4e138364f3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:59.087852 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-34ce1e1b-eed2-41b5-a12c-7a4e138364f3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:59.089398 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-34ce1e1b-eed2-41b5-a12c-7a4e138364f3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:14:59.090604 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-34ce1e1b-eed2-41b5-a12c-7a4e138364f3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1717 microversion: 2.20 time: 0.188860 Oct 11 12:14:59.091181 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 527/1100] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:14:58 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1717 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:14:59.124635 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-06e0b3b5-2575-4b8e-b22b-7c00a43c468f tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:14:59.126890 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-06e0b3b5-2575-4b8e-b22b-7c00a43c468f tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:14:59.134630 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06e0b3b5-2575-4b8e-b22b-7c00a43c468f tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:59.135146 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06e0b3b5-2575-4b8e-b22b-7c00a43c468f tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:59.135578 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06e0b3b5-2575-4b8e-b22b-7c00a43c468f tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:59.136289 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06e0b3b5-2575-4b8e-b22b-7c00a43c468f tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:14:59.136735 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06e0b3b5-2575-4b8e-b22b-7c00a43c468f tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:14:59.137154 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-06e0b3b5-2575-4b8e-b22b-7c00a43c468f tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:14:59.173324 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-06e0b3b5-2575-4b8e-b22b-7c00a43c468f tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053686 Oct 11 12:14:59.174236 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 574/1101] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Oct 11 12:14:59 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:15:00.185622 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-eca3a7e1-2a0a-4e21-8895-657c07537e17 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:15:00.187954 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-eca3a7e1-2a0a-4e21-8895-657c07537e17 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:15:00.194851 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eca3a7e1-2a0a-4e21-8895-657c07537e17 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:00.195326 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eca3a7e1-2a0a-4e21-8895-657c07537e17 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:00.195784 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eca3a7e1-2a0a-4e21-8895-657c07537e17 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:00.196438 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eca3a7e1-2a0a-4e21-8895-657c07537e17 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:00.196938 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eca3a7e1-2a0a-4e21-8895-657c07537e17 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:00.197357 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-eca3a7e1-2a0a-4e21-8895-657c07537e17 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:00.227140 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-eca3a7e1-2a0a-4e21-8895-657c07537e17 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045368 Oct 11 12:15:00.227576 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 528/1102] 10.222.0.59 () {58 vars in 1302 bytes} [Tue Oct 11 12:15:00 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 12:15:00.238580 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-541afe64-05ea-4872-9e3f-61abb4470944 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:15:00.239119 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-541afe64-05ea-4872-9e3f-61abb4470944 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:15:00.245612 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-541afe64-05ea-4872-9e3f-61abb4470944 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:00.246062 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-541afe64-05ea-4872-9e3f-61abb4470944 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:00.246587 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-541afe64-05ea-4872-9e3f-61abb4470944 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:00.247225 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-541afe64-05ea-4872-9e3f-61abb4470944 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:00.247666 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-541afe64-05ea-4872-9e3f-61abb4470944 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:00.248093 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-541afe64-05ea-4872-9e3f-61abb4470944 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:00.325617 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-541afe64-05ea-4872-9e3f-61abb4470944 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] HTTP exception thrown: Instance 2fa95338-071a-4ea3-9562-c37c74c182ac is not attached to volume 7aa99961-c1de-4c52-b629-0fb5efd1f448 Oct 11 12:15:00.328099 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-541afe64-05ea-4872-9e3f-61abb4470944 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Request method failure captured: Oct 11 12:15:00.328099 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: request: DELETE /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac/os-volume_attachments/7aa99961-c1de-4c52-b629-0fb5efd1f448 HTTP/1.1 Oct 11 12:15:00.328099 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 11 12:15:00.328099 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 11 12:15:00.328099 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Connection: close Oct 11 12:15:00.328099 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 11 12:15:00.328099 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 11 12:15:00.328099 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Host: 10.222.0.59 Oct 11 12:15:00.328099 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 11 12:15:00.328099 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 11 12:15:00.328099 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjRV1shYwOEnJrlgxVOVQsSBEiQscDODyXkQCx1GZC73-DS3jxrUd5VzCO_3dJORSJGIBmQX5ZF01Fw4SmB-ZKqF0cWeraG5miff96-W_DqOtp55TBMVnm7p9ocaX5GEIztQunSiNyyo8KbfIHbk8PWVI60qaUijpiWuQgvkcgxMH_ISQ Oct 11 12:15:00.328099 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 11 12:15:00.328099 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 11 12:15:00.328099 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 11 12:15:00.328099 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 11 12:15:00.328099 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 11 12:15:00.328099 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 11 12:15:00.328099 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Id: f48db192fac04a06932590c23b751595 Oct 11 12:15:00.328099 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-TestMinimumBasicScenario-408027612 Oct 11 12:15:00.328099 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Role: reader,member Oct 11 12:15:00.328099 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Roles: reader,member Oct 11 12:15:00.329681 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f48db192fac04a06932590c23b751595"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f48db192fac04a06932590c23b751595"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f48db192fac04a06932590c23b751595"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f48db192fac04a06932590c23b751595"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:15:00.329681 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-TestMinimumBasicScenario-408027612 Oct 11 12:15:00.329681 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Id: f48db192fac04a06932590c23b751595 Oct 11 12:15:00.329681 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-TestMinimumBasicScenario-408027612 Oct 11 12:15:00.329681 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User: tempest-TestMinimumBasicScenario-408027612-project Oct 11 12:15:00.329681 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 11 12:15:00.329681 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 11 12:15:00.329681 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Id: 33ade5d60ccb44bab2e8ee2f0b21e456 Oct 11 12:15:00.329681 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-TestMinimumBasicScenario-408027612-project Oct 11 12:15:00.329681 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: method: > Oct 11 12:15:00.329681 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: exception: Instance 2fa95338-071a-4ea3-9562-c37c74c182ac is not attached to volume 7aa99961-c1de-4c52-b629-0fb5efd1f448 Oct 11 12:15:00.333729 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: action_args: {'server_id': '2fa95338-071a-4ea3-9562-c37c74c182ac', 'id': '7aa99961-c1de-4c52-b629-0fb5efd1f448'} Oct 11 12:15:00.333729 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:15:00.333729 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:00.333729 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 11 12:15:00.333729 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 11 12:15:00.333729 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 12:15:00.333729 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 12:15:00.333729 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 11 12:15:00.333729 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 11 12:15:00.333729 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 7aa99961-c1de-4c52-b629-0fb5efd1f448. Oct 11 12:15:00.333729 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:00.333729 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:15:00.333729 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:00.333729 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:00.333729 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:15:00.333729 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:15:00.333729 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:15:00.333729 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:15:00.333729 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:15:00.335336 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:15:00.335336 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 11 12:15:00.335336 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 12:15:00.335336 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fa95338-071a-4ea3-9562-c37c74c182ac is not attached to volume 7aa99961-c1de-4c52-b629-0fb5efd1f448 Oct 11 12:15:00.335336 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:00.335336 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:15:00.335336 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:00.335336 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:00.335336 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:15:00.335336 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:15:00.335336 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:15:00.335336 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:15:00.335336 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fa95338-071a-4ea3-9562-c37c74c182ac is not attached to volume 7aa99961-c1de-4c52-b629-0fb5efd1f448 Oct 11 12:15:00.335336 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:00.335336 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-541afe64-05ea-4872-9e3f-61abb4470944 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Returning 404 to user: Instance 2fa95338-071a-4ea3-9562-c37c74c182ac is not attached to volume 7aa99961-c1de-4c52-b629-0fb5efd1f448 {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:15:00.336953 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-541afe64-05ea-4872-9e3f-61abb4470944 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac/os-volume_attachments/7aa99961-c1de-4c52-b629-0fb5efd1f448" status: 404 len: 154 microversion: 2.1 time: 0.095014 Oct 11 12:15:00.336953 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 575/1103] 10.222.0.59 () {58 vars in 1416 bytes} [Tue Oct 11 12:15:00 2022] DELETE /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac/os-volume_attachments/7aa99961-c1de-4c52-b629-0fb5efd1f448 => generated 154 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:15:01.491727 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-3de9a38c-42df-4b54-a527-998542e1b4ad tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:15:01.492297 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-3de9a38c-42df-4b54-a527-998542e1b4ad tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:15:01.499582 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3de9a38c-42df-4b54-a527-998542e1b4ad tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:01.500035 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3de9a38c-42df-4b54-a527-998542e1b4ad tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:01.500463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3de9a38c-42df-4b54-a527-998542e1b4ad tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:01.501154 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3de9a38c-42df-4b54-a527-998542e1b4ad tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:01.501601 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3de9a38c-42df-4b54-a527-998542e1b4ad tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:01.502048 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3de9a38c-42df-4b54-a527-998542e1b4ad tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:01.530666 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-3de9a38c-42df-4b54-a527-998542e1b4ad tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Going to try to terminate instance {{(pid=118994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 12:15:01.614922 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-3de9a38c-42df-4b54-a527-998542e1b4ad tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 204 len: 0 microversion: 2.1 time: 0.126821 Oct 11 12:15:01.616204 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 529/1104] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Oct 11 12:15:01 2022] DELETE /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 12:15:01.625708 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8250b429-f753-424e-be58-fe729ac55a43 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:15:01.627133 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8250b429-f753-424e-be58-fe729ac55a43 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:15:01.631750 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 12:15:01.632099 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Tue Oct 11 12:15:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac (ip 10.222.0.59) !!! Oct 11 12:15:01.638057 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8250b429-f753-424e-be58-fe729ac55a43 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:01.638821 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8250b429-f753-424e-be58-fe729ac55a43 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:01.639488 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8250b429-f753-424e-be58-fe729ac55a43 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:01.640178 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8250b429-f753-424e-be58-fe729ac55a43 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:01.640650 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8250b429-f753-424e-be58-fe729ac55a43 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:01.641064 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8250b429-f753-424e-be58-fe729ac55a43 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:01.779289 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8250b429-f753-424e-be58-fe729ac55a43 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:15:01.787627 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8250b429-f753-424e-be58-fe729ac55a43 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1555 microversion: 2.1 time: 0.165717 Oct 11 12:15:01.788116 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 576/1105] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:15:01 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1555 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:15:02.813114 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-7fcc2f6d-6e32-4d56-aa8f-8b400d813ad7 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:15:02.813874 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-7fcc2f6d-6e32-4d56-aa8f-8b400d813ad7 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:15:02.816110 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 12:15:02.816255 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Tue Oct 11 12:15:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac (ip 10.222.0.59) !!! Oct 11 12:15:02.824002 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7fcc2f6d-6e32-4d56-aa8f-8b400d813ad7 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:02.824481 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7fcc2f6d-6e32-4d56-aa8f-8b400d813ad7 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:02.824938 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7fcc2f6d-6e32-4d56-aa8f-8b400d813ad7 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:02.825636 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7fcc2f6d-6e32-4d56-aa8f-8b400d813ad7 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:02.826091 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7fcc2f6d-6e32-4d56-aa8f-8b400d813ad7 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:02.826535 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7fcc2f6d-6e32-4d56-aa8f-8b400d813ad7 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:02.969502 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-7fcc2f6d-6e32-4d56-aa8f-8b400d813ad7 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:15:02.981677 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-7fcc2f6d-6e32-4d56-aa8f-8b400d813ad7 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1555 microversion: 2.1 time: 0.172550 Oct 11 12:15:02.982467 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 530/1106] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:15:02 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1555 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:15:04.005560 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6bfe13c3-9beb-4498-b053-dbd5af7b60a5 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:15:04.006198 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-6bfe13c3-9beb-4498-b053-dbd5af7b60a5 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:15:04.013553 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6bfe13c3-9beb-4498-b053-dbd5af7b60a5 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:04.014039 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6bfe13c3-9beb-4498-b053-dbd5af7b60a5 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:04.014460 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6bfe13c3-9beb-4498-b053-dbd5af7b60a5 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:04.015419 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6bfe13c3-9beb-4498-b053-dbd5af7b60a5 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:04.015874 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6bfe13c3-9beb-4498-b053-dbd5af7b60a5 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:04.016293 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6bfe13c3-9beb-4498-b053-dbd5af7b60a5 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:04.118620 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6bfe13c3-9beb-4498-b053-dbd5af7b60a5 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '33ade5d60ccb44bab2e8ee2f0b21e456', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f48db192fac04a06932590c23b751595', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:15:04.126575 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6bfe13c3-9beb-4498-b053-dbd5af7b60a5 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 200 len: 1513 microversion: 2.1 time: 0.124842 Oct 11 12:15:04.127131 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 577/1107] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:15:04 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 1513 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:15:04.153325 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-b0381c0a-a9cd-47aa-8f9b-fe35ed8aca6a req-2229f16f-bfce-4e4d-867f-4a07fdf9ffc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2fa95338-071a-4ea3-9562-c37c74c182ac", "name": "network-vif-deleted", "tag": "91b90de7-e871-422f-a2ac-9331cb77b634"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:15:04.164098 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-b0381c0a-a9cd-47aa-8f9b-fe35ed8aca6a req-2229f16f-bfce-4e4d-867f-4a07fdf9ffc6 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:04.164573 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-b0381c0a-a9cd-47aa-8f9b-fe35ed8aca6a req-2229f16f-bfce-4e4d-867f-4a07fdf9ffc6 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:04.164995 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-b0381c0a-a9cd-47aa-8f9b-fe35ed8aca6a req-2229f16f-bfce-4e4d-867f-4a07fdf9ffc6 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:04.178291 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-b0381c0a-a9cd-47aa-8f9b-fe35ed8aca6a req-2229f16f-bfce-4e4d-867f-4a07fdf9ffc6 service nova] Creating event network-vif-deleted:91b90de7-e871-422f-a2ac-9331cb77b634 for instance 2fa95338-071a-4ea3-9562-c37c74c182ac on hv-cinder-82099 Oct 11 12:15:04.183210 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-b0381c0a-a9cd-47aa-8f9b-fe35ed8aca6a req-2229f16f-bfce-4e4d-867f-4a07fdf9ffc6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033560 Oct 11 12:15:04.184023 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 531/1108] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:15:05.154785 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2cfb1138-e5dc-4b89-85df-6010ada31cba tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:15:05.155503 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2cfb1138-e5dc-4b89-85df-6010ada31cba tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] [instance: 2fa95338-071a-4ea3-9562-c37c74c182ac] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:15:05.162200 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2cfb1138-e5dc-4b89-85df-6010ada31cba tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:05.162710 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2cfb1138-e5dc-4b89-85df-6010ada31cba tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:05.163140 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2cfb1138-e5dc-4b89-85df-6010ada31cba tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:05.163835 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2cfb1138-e5dc-4b89-85df-6010ada31cba tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:05.164286 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2cfb1138-e5dc-4b89-85df-6010ada31cba tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:05.164704 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2cfb1138-e5dc-4b89-85df-6010ada31cba tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:05.179015 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-2cfb1138-e5dc-4b89-85df-6010ada31cba tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] HTTP exception thrown: Instance 2fa95338-071a-4ea3-9562-c37c74c182ac could not be found. Oct 11 12:15:05.180601 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2cfb1138-e5dc-4b89-85df-6010ada31cba tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Request method failure captured: Oct 11 12:15:05.180601 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac HTTP/1.1 Oct 11 12:15:05.180601 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 11 12:15:05.180601 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 11 12:15:05.180601 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Connection: close Oct 11 12:15:05.180601 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 11 12:15:05.180601 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 11 12:15:05.180601 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Host: 10.222.0.59 Oct 11 12:15:05.180601 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 11 12:15:05.180601 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 11 12:15:05.180601 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjRV1shYwOEnJrlgxVOVQsSBEiQscDODyXkQCx1GZC73-DS3jxrUd5VzCO_3dJORSJGIBmQX5ZF01Fw4SmB-ZKqF0cWeraG5miff96-W_DqOtp55TBMVnm7p9ocaX5GEIztQunSiNyyo8KbfIHbk8PWVI60qaUijpiWuQgvkcgxMH_ISQ Oct 11 12:15:05.180601 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 11 12:15:05.180601 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 11 12:15:05.180601 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 11 12:15:05.180601 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 11 12:15:05.180601 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 11 12:15:05.180601 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 11 12:15:05.180601 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Id: f48db192fac04a06932590c23b751595 Oct 11 12:15:05.180601 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-TestMinimumBasicScenario-408027612 Oct 11 12:15:05.180601 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Role: reader,member Oct 11 12:15:05.180601 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Roles: reader,member Oct 11 12:15:05.182197 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f48db192fac04a06932590c23b751595"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f48db192fac04a06932590c23b751595"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f48db192fac04a06932590c23b751595"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f48db192fac04a06932590c23b751595"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:15:05.182197 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-TestMinimumBasicScenario-408027612 Oct 11 12:15:05.182197 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Id: f48db192fac04a06932590c23b751595 Oct 11 12:15:05.182197 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-TestMinimumBasicScenario-408027612 Oct 11 12:15:05.182197 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User: tempest-TestMinimumBasicScenario-408027612-project Oct 11 12:15:05.182197 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 11 12:15:05.182197 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 11 12:15:05.182197 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Id: 33ade5d60ccb44bab2e8ee2f0b21e456 Oct 11 12:15:05.182197 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-TestMinimumBasicScenario-408027612-project Oct 11 12:15:05.182197 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: method: > Oct 11 12:15:05.182197 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: exception: Instance 2fa95338-071a-4ea3-9562-c37c74c182ac could not be found. Oct 11 12:15:05.182197 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: action_args: {'id': '2fa95338-071a-4ea3-9562-c37c74c182ac'} Oct 11 12:15:05.183263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:15:05.183263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:05.183263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:15:05.183263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:15:05.183263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:15:05.183263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:15:05.183263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:15:05.183263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:15:05.183263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:15:05.183263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:15:05.183263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2fa95338-071a-4ea3-9562-c37c74c182ac could not be found. Oct 11 12:15:05.183263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:05.183263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:15:05.183263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:05.183263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:05.183263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:15:05.183263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:15:05.183263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:15:05.183263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:15:05.183263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:15:05.184868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:15:05.184868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 12:15:05.184868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 12:15:05.184868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:15:05.184868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:15:05.184868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:15:05.184868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:15:05.184868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2fa95338-071a-4ea3-9562-c37c74c182ac could not be found. Oct 11 12:15:05.184868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:05.184868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:15:05.184868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:05.184868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:05.184868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:15:05.184868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:15:05.184868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:15:05.184868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:15:05.184868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2fa95338-071a-4ea3-9562-c37c74c182ac could not be found. Oct 11 12:15:05.184868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:05.186382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2cfb1138-e5dc-4b89-85df-6010ada31cba tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Returning 404 to user: Instance 2fa95338-071a-4ea3-9562-c37c74c182ac could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:15:05.186382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2cfb1138-e5dc-4b89-85df-6010ada31cba tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac" status: 404 len: 111 microversion: 2.1 time: 0.033105 Oct 11 12:15:05.186382 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 578/1109] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:15:05 2022] GET /compute/v2.1/servers/2fa95338-071a-4ea3-9562-c37c74c182ac => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:15:05.192053 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-3ae0d7c1-9242-4ea0-85c7-2057e7ee4e45 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] Calling method '.version_select at 0x7fd4066e89d0>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:15:05.214862 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-3ae0d7c1-9242-4ea0-85c7-2057e7ee4e45 tempest-TestMinimumBasicScenario-408027612 tempest-TestMinimumBasicScenario-408027612-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1069425504" status: 202 len: 0 microversion: 2.1 time: 0.027122 Oct 11 12:15:05.215636 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 532/1110] 10.222.0.59 () {58 vars in 1272 bytes} [Tue Oct 11 12:15:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1069425504 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 12:15:47.723074 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-517a3a67-1a70-419e-ab91-8a96c6742e7f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:15:47.725427 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-517a3a67-1a70-419e-ab91-8a96c6742e7f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:15:47.727880 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=21 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:15:47.728524 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=63 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:15:47.733711 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-517a3a67-1a70-419e-ab91-8a96c6742e7f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:47.734214 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-517a3a67-1a70-419e-ab91-8a96c6742e7f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:47.734650 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-517a3a67-1a70-419e-ab91-8a96c6742e7f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:47.735329 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-517a3a67-1a70-419e-ab91-8a96c6742e7f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:47.735773 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-517a3a67-1a70-419e-ab91-8a96c6742e7f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:47.736184 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-517a3a67-1a70-419e-ab91-8a96c6742e7f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:47.765444 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-517a3a67-1a70-419e-ab91-8a96c6742e7f tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046563 Oct 11 12:15:47.766023 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 579/1111] 10.222.0.59 () {60 vars in 1343 bytes} [Tue Oct 11 12:15:47 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:15:47.827410 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:15:47.828124 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:15:47.832295 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-d5ccff92-9470-4aa7-b72a-e561bb9a3b46 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:15:47.832874 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-d5ccff92-9470-4aa7-b72a-e561bb9a3b46 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:15:47.841723 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d5ccff92-9470-4aa7-b72a-e561bb9a3b46 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:47.842206 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d5ccff92-9470-4aa7-b72a-e561bb9a3b46 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:47.842672 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d5ccff92-9470-4aa7-b72a-e561bb9a3b46 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:47.843378 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d5ccff92-9470-4aa7-b72a-e561bb9a3b46 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:47.843827 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d5ccff92-9470-4aa7-b72a-e561bb9a3b46 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:47.844247 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d5ccff92-9470-4aa7-b72a-e561bb9a3b46 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:47.871798 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-d5ccff92-9470-4aa7-b72a-e561bb9a3b46 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Going to try to terminate instance {{(pid=118994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 12:15:47.952832 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-d5ccff92-9470-4aa7-b72a-e561bb9a3b46 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 204 len: 0 microversion: 2.20 time: 0.126777 Oct 11 12:15:47.953379 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 533/1112] 10.222.0.59 () {60 vars in 1280 bytes} [Tue Oct 11 12:15:47 2022] DELETE /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 12:15:47.961837 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f089c383-3cff-4ad1-a1a9-f4850a5d59a2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:15:47.962471 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f089c383-3cff-4ad1-a1a9-f4850a5d59a2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:15:47.968818 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f089c383-3cff-4ad1-a1a9-f4850a5d59a2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:47.969301 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f089c383-3cff-4ad1-a1a9-f4850a5d59a2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:47.969734 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f089c383-3cff-4ad1-a1a9-f4850a5d59a2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:47.970428 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f089c383-3cff-4ad1-a1a9-f4850a5d59a2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:47.970904 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f089c383-3cff-4ad1-a1a9-f4850a5d59a2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:47.971319 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f089c383-3cff-4ad1-a1a9-f4850a5d59a2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:48.106079 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f089c383-3cff-4ad1-a1a9-f4850a5d59a2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:15:48.114615 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f089c383-3cff-4ad1-a1a9-f4850a5d59a2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:15:48.116076 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-f089c383-3cff-4ad1-a1a9-f4850a5d59a2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:15:48.117229 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f089c383-3cff-4ad1-a1a9-f4850a5d59a2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1723 microversion: 2.20 time: 0.159323 Oct 11 12:15:48.117767 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 580/1113] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:15:47 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:15:49.143529 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-26f2493c-9b44-4d93-81ea-eb4f63513af4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:15:49.144286 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-26f2493c-9b44-4d93-81ea-eb4f63513af4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:15:49.151724 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-26f2493c-9b44-4d93-81ea-eb4f63513af4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:49.152220 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-26f2493c-9b44-4d93-81ea-eb4f63513af4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:49.152667 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-26f2493c-9b44-4d93-81ea-eb4f63513af4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:49.153381 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-26f2493c-9b44-4d93-81ea-eb4f63513af4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:49.153844 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-26f2493c-9b44-4d93-81ea-eb4f63513af4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:49.154280 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-26f2493c-9b44-4d93-81ea-eb4f63513af4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:49.294892 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-26f2493c-9b44-4d93-81ea-eb4f63513af4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:15:49.307923 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-26f2493c-9b44-4d93-81ea-eb4f63513af4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:15:49.309852 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-26f2493c-9b44-4d93-81ea-eb4f63513af4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:15:49.311062 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-26f2493c-9b44-4d93-81ea-eb4f63513af4 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1723 microversion: 2.20 time: 0.172096 Oct 11 12:15:49.311656 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 534/1114] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:15:49 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:15:50.335872 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-b234730b-f134-49ae-98f8-e655d98404b3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:15:50.336501 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-b234730b-f134-49ae-98f8-e655d98404b3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:15:50.343116 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b234730b-f134-49ae-98f8-e655d98404b3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:50.343592 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b234730b-f134-49ae-98f8-e655d98404b3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:50.344011 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b234730b-f134-49ae-98f8-e655d98404b3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:50.344758 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b234730b-f134-49ae-98f8-e655d98404b3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:50.345229 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b234730b-f134-49ae-98f8-e655d98404b3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:50.345641 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-b234730b-f134-49ae-98f8-e655d98404b3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:50.411483 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-b234730b-f134-49ae-98f8-e655d98404b3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:15:50.419714 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-b234730b-f134-49ae-98f8-e655d98404b3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:15:50.421149 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-b234730b-f134-49ae-98f8-e655d98404b3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abfa19ab0a624de6ab082e8b1e57a220', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fee1ecae514e4c79a4f0fe601391971d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:15:50.422313 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-b234730b-f134-49ae-98f8-e655d98404b3 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 200 len: 1655 microversion: 2.20 time: 0.090530 Oct 11 12:15:50.422893 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 581/1115] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:15:50 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 1655 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 12:15:50.525839 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-3c991840-6213-499d-b064-bc772a7b9937 req-cefa9fbf-0a4b-4a83-a2ee-f29f70d01208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f7ef566-fc3f-4b87-96a7-2d2a650a4d15", "name": "network-vif-deleted", "tag": "587860e6-e550-42be-bb20-fe198f47ec93"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:15:50.537257 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-3c991840-6213-499d-b064-bc772a7b9937 req-cefa9fbf-0a4b-4a83-a2ee-f29f70d01208 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:50.537759 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-3c991840-6213-499d-b064-bc772a7b9937 req-cefa9fbf-0a4b-4a83-a2ee-f29f70d01208 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:50.538186 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-3c991840-6213-499d-b064-bc772a7b9937 req-cefa9fbf-0a4b-4a83-a2ee-f29f70d01208 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:50.549813 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-3c991840-6213-499d-b064-bc772a7b9937 req-cefa9fbf-0a4b-4a83-a2ee-f29f70d01208 service nova] Creating event network-vif-deleted:587860e6-e550-42be-bb20-fe198f47ec93 for instance 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 on hv-cinder-82099 Oct 11 12:15:50.555043 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-3c991840-6213-499d-b064-bc772a7b9937 req-cefa9fbf-0a4b-4a83-a2ee-f29f70d01208 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033354 Oct 11 12:15:50.555640 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 535/1116] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:15:51.447724 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-4b218146-64b1-410a-bd4d-d6fd07a61fa5 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:15:51.448337 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-4b218146-64b1-410a-bd4d-d6fd07a61fa5 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:15:51.455623 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4b218146-64b1-410a-bd4d-d6fd07a61fa5 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:51.456111 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4b218146-64b1-410a-bd4d-d6fd07a61fa5 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:51.456539 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4b218146-64b1-410a-bd4d-d6fd07a61fa5 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:51.457236 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4b218146-64b1-410a-bd4d-d6fd07a61fa5 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:51.457704 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4b218146-64b1-410a-bd4d-d6fd07a61fa5 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:51.458124 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4b218146-64b1-410a-bd4d-d6fd07a61fa5 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:51.474398 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-4b218146-64b1-410a-bd4d-d6fd07a61fa5 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] HTTP exception thrown: Instance 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 could not be found. Oct 11 12:15:51.476053 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-4b218146-64b1-410a-bd4d-d6fd07a61fa5 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Request method failure captured: Oct 11 12:15:51.476053 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 HTTP/1.1 Oct 11 12:15:51.476053 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 11 12:15:51.476053 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 11 12:15:51.476053 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Connection: close Oct 11 12:15:51.476053 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 11 12:15:51.476053 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 11 12:15:51.476053 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Host: 10.222.0.59 Oct 11 12:15:51.476053 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 11 12:15:51.476053 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 11 12:15:51.476053 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjRVyOMBKd26owVfU6SSh2w6xAae8qJvUd5mAUTdnNIRwDSx6TAHiasVGas-qC_lxwzPP8nnCxoANLf3SBvIOQlovMeFH1EzwPme9zR6R7OLSyQ-XNd81RFR2CJ0GQsyD5kN1UAPTybpLXawK3rq_7dBEKv7_dBCuh3bN3b4428vp4NbQ Oct 11 12:15:51.476053 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 11 12:15:51.476053 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 11 12:15:51.476053 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 11 12:15:51.476053 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 11 12:15:51.476053 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 12:15:51.476053 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 11 12:15:51.476053 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 11 12:15:51.476053 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Id: fee1ecae514e4c79a4f0fe601391971d Oct 11 12:15:51.476053 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-857450641 Oct 11 12:15:51.476053 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Role: reader,member Oct 11 12:15:51.476053 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Roles: reader,member Oct 11 12:15:51.477868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/fee1ecae514e4c79a4f0fe601391971d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_fee1ecae514e4c79a4f0fe601391971d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fee1ecae514e4c79a4f0fe601391971d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fee1ecae514e4c79a4f0fe601391971d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:15:51.477868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-AttachVolumeShelveTestJSON-857450641 Oct 11 12:15:51.477868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Id: fee1ecae514e4c79a4f0fe601391971d Oct 11 12:15:51.477868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-857450641 Oct 11 12:15:51.477868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User: tempest-AttachVolumeShelveTestJSON-857450641-project Oct 11 12:15:51.477868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 11 12:15:51.477868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 11 12:15:51.477868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Id: abfa19ab0a624de6ab082e8b1e57a220 Oct 11 12:15:51.477868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-AttachVolumeShelveTestJSON-857450641-project Oct 11 12:15:51.477868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: method: > Oct 11 12:15:51.477868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: exception: Instance 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 could not be found. Oct 11 12:15:51.477868 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: action_args: {'id': '2f7ef566-fc3f-4b87-96a7-2d2a650a4d15'} Oct 11 12:15:51.478767 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:15:51.478767 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:51.478767 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:15:51.478767 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:15:51.478767 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:15:51.478767 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:15:51.478767 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:15:51.478767 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:15:51.478767 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:15:51.478767 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:15:51.478767 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 could not be found. Oct 11 12:15:51.478767 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:51.478767 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:15:51.478767 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:51.478767 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:51.478767 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:15:51.478767 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:15:51.478767 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:15:51.478767 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:15:51.478767 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:15:51.480147 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:15:51.480147 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 12:15:51.480147 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 12:15:51.480147 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:15:51.480147 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:15:51.480147 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:15:51.480147 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:15:51.480147 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 could not be found. Oct 11 12:15:51.480147 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:51.480147 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:15:51.480147 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:51.480147 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:51.480147 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:15:51.480147 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:15:51.480147 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:15:51.480147 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:15:51.480147 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 could not be found. Oct 11 12:15:51.480147 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:51.481375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-4b218146-64b1-410a-bd4d-d6fd07a61fa5 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Returning 404 to user: Instance 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:15:51.481375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-4b218146-64b1-410a-bd4d-d6fd07a61fa5 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 404 len: 111 microversion: 2.20 time: 0.033774 Oct 11 12:15:51.481375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 582/1117] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:15:51 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 12:15:51.487885 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-295f83d0-679b-48c1-bf52-32778cb6f2b6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '.version_select at 0x7fd4068614c0>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:15:51.510075 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-295f83d0-679b-48c1-bf52-32778cb6f2b6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-707816474" status: 204 len: 0 microversion: 2.20 time: 0.026505 Oct 11 12:15:51.510749 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 536/1118] 10.222.0.59 () {60 vars in 1259 bytes} [Tue Oct 11 12:15:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-707816474 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 12:15:53.298202 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2b71c8e1-bb02-454d-b87a-90d215b443ba tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:15:53.298766 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2b71c8e1-bb02-454d-b87a-90d215b443ba tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:15:53.305610 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2b71c8e1-bb02-454d-b87a-90d215b443ba tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:53.306097 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2b71c8e1-bb02-454d-b87a-90d215b443ba tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:53.306526 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2b71c8e1-bb02-454d-b87a-90d215b443ba tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:53.307257 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2b71c8e1-bb02-454d-b87a-90d215b443ba tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:53.307713 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2b71c8e1-bb02-454d-b87a-90d215b443ba tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:53.308134 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2b71c8e1-bb02-454d-b87a-90d215b443ba tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:53.322093 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-2b71c8e1-bb02-454d-b87a-90d215b443ba tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] HTTP exception thrown: Instance 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 could not be found. Oct 11 12:15:53.323764 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2b71c8e1-bb02-454d-b87a-90d215b443ba tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Request method failure captured: Oct 11 12:15:53.323764 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: request: DELETE /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 HTTP/1.1 Oct 11 12:15:53.323764 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 11 12:15:53.323764 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 11 12:15:53.323764 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Connection: close Oct 11 12:15:53.323764 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 11 12:15:53.323764 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 11 12:15:53.323764 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Host: 10.222.0.59 Oct 11 12:15:53.323764 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 11 12:15:53.323764 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 11 12:15:53.323764 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjRVyOMBKd26owVfU6SSh2w6xAae8qJvUd5mAUTdnNIRwDSx6TAHiasVGas-qC_lxwzPP8nnCxoANLf3SBvIOQlovMeFH1EzwPme9zR6R7OLSyQ-XNd81RFR2CJ0GQsyD5kN1UAPTybpLXawK3rq_7dBEKv7_dBCuh3bN3b4428vp4NbQ Oct 11 12:15:53.323764 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 11 12:15:53.323764 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 11 12:15:53.323764 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 11 12:15:53.323764 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 11 12:15:53.323764 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 12:15:53.323764 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 11 12:15:53.323764 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 11 12:15:53.323764 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Id: fee1ecae514e4c79a4f0fe601391971d Oct 11 12:15:53.323764 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-857450641 Oct 11 12:15:53.323764 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Role: reader,member Oct 11 12:15:53.323764 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Roles: reader,member Oct 11 12:15:53.325584 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/fee1ecae514e4c79a4f0fe601391971d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_fee1ecae514e4c79a4f0fe601391971d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fee1ecae514e4c79a4f0fe601391971d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fee1ecae514e4c79a4f0fe601391971d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:15:53.325584 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-AttachVolumeShelveTestJSON-857450641 Oct 11 12:15:53.325584 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Id: fee1ecae514e4c79a4f0fe601391971d Oct 11 12:15:53.325584 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-857450641 Oct 11 12:15:53.325584 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User: tempest-AttachVolumeShelveTestJSON-857450641-project Oct 11 12:15:53.325584 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 11 12:15:53.325584 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 11 12:15:53.325584 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Id: abfa19ab0a624de6ab082e8b1e57a220 Oct 11 12:15:53.325584 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-AttachVolumeShelveTestJSON-857450641-project Oct 11 12:15:53.325584 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: method: > Oct 11 12:15:53.325584 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: exception: Instance 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 could not be found. Oct 11 12:15:53.325584 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: action_args: {'id': '2f7ef566-fc3f-4b87-96a7-2d2a650a4d15'} Oct 11 12:15:53.326497 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:15:53.326497 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:53.326497 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:15:53.326497 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:15:53.326497 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:15:53.326497 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:15:53.326497 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:15:53.326497 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:15:53.326497 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:15:53.326497 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:15:53.326497 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 could not be found. Oct 11 12:15:53.326497 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:53.326497 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:15:53.326497 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:53.326497 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:53.326497 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:15:53.326497 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:15:53.326497 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:15:53.326497 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:15:53.326497 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:15:53.328035 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:15:53.328035 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 12:15:53.328035 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 12:15:53.328035 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 12:15:53.328035 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 12:15:53.328035 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:15:53.328035 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:15:53.328035 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:15:53.328035 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:15:53.328035 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 could not be found. Oct 11 12:15:53.328035 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:53.328035 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:15:53.328035 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:53.328035 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:53.328035 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:15:53.328035 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:15:53.328035 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:15:53.328035 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:15:53.328035 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 could not be found. Oct 11 12:15:53.328035 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:53.329788 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2b71c8e1-bb02-454d-b87a-90d215b443ba tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Returning 404 to user: Instance 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:15:53.329788 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2b71c8e1-bb02-454d-b87a-90d215b443ba tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 404 len: 111 microversion: 2.20 time: 0.031002 Oct 11 12:15:53.329788 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 583/1119] 10.222.0.59 () {60 vars in 1280 bytes} [Tue Oct 11 12:15:53 2022] DELETE /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 12:15:53.333660 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-1ed890af-1e30-4c48-b6fa-43e1ba79e9f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:15:53.334381 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-1ed890af-1e30-4c48-b6fa-43e1ba79e9f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:15:53.341844 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1ed890af-1e30-4c48-b6fa-43e1ba79e9f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:53.342311 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1ed890af-1e30-4c48-b6fa-43e1ba79e9f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:53.342770 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1ed890af-1e30-4c48-b6fa-43e1ba79e9f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:53.343449 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1ed890af-1e30-4c48-b6fa-43e1ba79e9f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:53.343888 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1ed890af-1e30-4c48-b6fa-43e1ba79e9f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:53.344298 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1ed890af-1e30-4c48-b6fa-43e1ba79e9f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:53.359881 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.wsgi [None req-1ed890af-1e30-4c48-b6fa-43e1ba79e9f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] HTTP exception thrown: Instance 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 could not be found. Oct 11 12:15:53.361484 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-1ed890af-1e30-4c48-b6fa-43e1ba79e9f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Request method failure captured: Oct 11 12:15:53.361484 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: request: GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 HTTP/1.1 Oct 11 12:15:53.361484 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept: application/json Oct 11 12:15:53.361484 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept-Encoding: identity Oct 11 12:15:53.361484 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Connection: close Oct 11 12:15:53.361484 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Length: 0 Oct 11 12:15:53.361484 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Type: application/json Oct 11 12:15:53.361484 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Host: 10.222.0.59 Oct 11 12:15:53.361484 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Openstack-System-Scope: None Oct 11 12:15:53.361484 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: User-Agent: python-urllib3/1.26.12 Oct 11 12:15:53.361484 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Auth-Token: gAAAAABjRVyOMBKd26owVfU6SSh2w6xAae8qJvUd5mAUTdnNIRwDSx6TAHiasVGas-qC_lxwzPP8nnCxoANLf3SBvIOQlovMeFH1EzwPme9zR6R7OLSyQ-XNd81RFR2CJ0GQsyD5kN1UAPTybpLXawK3rq_7dBEKv7_dBCuh3bN3b4428vp4NbQ Oct 11 12:15:53.361484 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Id: None Oct 11 12:15:53.361484 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Name: None Oct 11 12:15:53.361484 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Identity-Status: Confirmed Oct 11 12:15:53.361484 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Is-Admin-Project: True Oct 11 12:15:53.361484 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 12:15:53.361484 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Id: default Oct 11 12:15:53.361484 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Name: Default Oct 11 12:15:53.361484 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Id: fee1ecae514e4c79a4f0fe601391971d Oct 11 12:15:53.361484 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-857450641 Oct 11 12:15:53.361484 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Role: reader,member Oct 11 12:15:53.361484 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Roles: reader,member Oct 11 12:15:53.363336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/fee1ecae514e4c79a4f0fe601391971d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_fee1ecae514e4c79a4f0fe601391971d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fee1ecae514e4c79a4f0fe601391971d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fee1ecae514e4c79a4f0fe601391971d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:15:53.363336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant: tempest-AttachVolumeShelveTestJSON-857450641 Oct 11 12:15:53.363336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Id: fee1ecae514e4c79a4f0fe601391971d Oct 11 12:15:53.363336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-857450641 Oct 11 12:15:53.363336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User: tempest-AttachVolumeShelveTestJSON-857450641-project Oct 11 12:15:53.363336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Id: default Oct 11 12:15:53.363336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Name: Default Oct 11 12:15:53.363336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Id: abfa19ab0a624de6ab082e8b1e57a220 Oct 11 12:15:53.363336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Name: tempest-AttachVolumeShelveTestJSON-857450641-project Oct 11 12:15:53.363336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: method: > Oct 11 12:15:53.363336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: exception: Instance 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 could not be found. Oct 11 12:15:53.363336 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: action_args: {'id': '2f7ef566-fc3f-4b87-96a7-2d2a650a4d15'} Oct 11 12:15:53.364289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:15:53.364289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:53.364289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:15:53.364289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:15:53.364289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:15:53.364289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:15:53.364289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:15:53.364289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:15:53.364289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:15:53.364289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:15:53.364289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 could not be found. Oct 11 12:15:53.364289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:15:53.364289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:15:53.364289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:15:53.364289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:53.364289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:15:53.364289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:15:53.364289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:15:53.364289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:15:53.364289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:15:53.365763 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:15:53.365763 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 12:15:53.365763 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 12:15:53.365763 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:15:53.365763 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:15:53.365763 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:15:53.365763 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:15:53.365763 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 could not be found. Oct 11 12:15:53.365763 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:15:53.365763 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:15:53.365763 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:15:53.365763 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:53.365763 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:15:53.365763 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:15:53.365763 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:15:53.365763 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:15:53.365763 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 could not be found. Oct 11 12:15:53.365763 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:15:53.367136 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-1ed890af-1e30-4c48-b6fa-43e1ba79e9f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Returning 404 to user: Instance 2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 could not be found. {{(pid=118994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:15:53.367136 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-1ed890af-1e30-4c48-b6fa-43e1ba79e9f6 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15" status: 404 len: 111 microversion: 2.20 time: 0.033046 Oct 11 12:15:53.367136 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 537/1120] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:15:53 2022] GET /compute/v2.1/servers/2f7ef566-fc3f-4b87-96a7-2d2a650a4d15 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 12:15:54.675715 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-191dbbb5-9328-4dc5-8747-045b0a5e14e2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:15:54.676200 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-191dbbb5-9328-4dc5-8747-045b0a5e14e2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:15:54.683104 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-191dbbb5-9328-4dc5-8747-045b0a5e14e2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:54.683608 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-191dbbb5-9328-4dc5-8747-045b0a5e14e2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:54.684124 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-191dbbb5-9328-4dc5-8747-045b0a5e14e2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:54.684821 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-191dbbb5-9328-4dc5-8747-045b0a5e14e2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:54.685273 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-191dbbb5-9328-4dc5-8747-045b0a5e14e2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:54.685693 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-191dbbb5-9328-4dc5-8747-045b0a5e14e2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:54.699305 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-191dbbb5-9328-4dc5-8747-045b0a5e14e2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] HTTP exception thrown: Instance 2f1f910a-6135-426a-97a7-570948cf922c could not be found. Oct 11 12:15:54.701366 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-191dbbb5-9328-4dc5-8747-045b0a5e14e2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Request method failure captured: Oct 11 12:15:54.701366 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: request: DELETE /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c HTTP/1.1 Oct 11 12:15:54.701366 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 11 12:15:54.701366 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 11 12:15:54.701366 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Connection: close Oct 11 12:15:54.701366 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 11 12:15:54.701366 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 11 12:15:54.701366 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Host: 10.222.0.59 Oct 11 12:15:54.701366 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 11 12:15:54.701366 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 11 12:15:54.701366 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjRVyOMBKd26owVfU6SSh2w6xAae8qJvUd5mAUTdnNIRwDSx6TAHiasVGas-qC_lxwzPP8nnCxoANLf3SBvIOQlovMeFH1EzwPme9zR6R7OLSyQ-XNd81RFR2CJ0GQsyD5kN1UAPTybpLXawK3rq_7dBEKv7_dBCuh3bN3b4428vp4NbQ Oct 11 12:15:54.701366 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 11 12:15:54.701366 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 11 12:15:54.701366 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 11 12:15:54.701366 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 11 12:15:54.701366 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 12:15:54.701366 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 11 12:15:54.701366 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 11 12:15:54.701366 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Id: fee1ecae514e4c79a4f0fe601391971d Oct 11 12:15:54.701366 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-857450641 Oct 11 12:15:54.701366 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Role: reader,member Oct 11 12:15:54.701366 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Roles: reader,member Oct 11 12:15:54.702941 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/fee1ecae514e4c79a4f0fe601391971d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_fee1ecae514e4c79a4f0fe601391971d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fee1ecae514e4c79a4f0fe601391971d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fee1ecae514e4c79a4f0fe601391971d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:15:54.702941 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-AttachVolumeShelveTestJSON-857450641 Oct 11 12:15:54.702941 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Id: fee1ecae514e4c79a4f0fe601391971d Oct 11 12:15:54.702941 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-857450641 Oct 11 12:15:54.702941 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User: tempest-AttachVolumeShelveTestJSON-857450641-project Oct 11 12:15:54.702941 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 11 12:15:54.702941 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 11 12:15:54.702941 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Id: abfa19ab0a624de6ab082e8b1e57a220 Oct 11 12:15:54.702941 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-AttachVolumeShelveTestJSON-857450641-project Oct 11 12:15:54.702941 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: method: > Oct 11 12:15:54.702941 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: exception: Instance 2f1f910a-6135-426a-97a7-570948cf922c could not be found. Oct 11 12:15:54.702941 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: action_args: {'id': '2f1f910a-6135-426a-97a7-570948cf922c'} Oct 11 12:15:54.703706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:15:54.703706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:54.703706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:15:54.703706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:15:54.703706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:15:54.703706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:15:54.703706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:15:54.703706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:15:54.703706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:15:54.703706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:15:54.703706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f1f910a-6135-426a-97a7-570948cf922c could not be found. Oct 11 12:15:54.703706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:54.703706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:15:54.703706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:54.703706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:54.703706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:15:54.703706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:15:54.703706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:15:54.703706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:15:54.703706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:15:54.705005 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:15:54.705005 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 12:15:54.705005 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 12:15:54.705005 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 12:15:54.705005 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 12:15:54.705005 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:15:54.705005 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:15:54.705005 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:15:54.705005 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:15:54.705005 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f1f910a-6135-426a-97a7-570948cf922c could not be found. Oct 11 12:15:54.705005 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:54.705005 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:15:54.705005 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:54.705005 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:54.705005 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:15:54.705005 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:15:54.705005 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:15:54.705005 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:15:54.705005 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f1f910a-6135-426a-97a7-570948cf922c could not be found. Oct 11 12:15:54.705005 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:54.706366 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-191dbbb5-9328-4dc5-8747-045b0a5e14e2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Returning 404 to user: Instance 2f1f910a-6135-426a-97a7-570948cf922c could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:15:54.706366 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-191dbbb5-9328-4dc5-8747-045b0a5e14e2 tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 404 len: 111 microversion: 2.20 time: 0.031207 Oct 11 12:15:54.706366 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 584/1121] 10.222.0.59 () {60 vars in 1280 bytes} [Tue Oct 11 12:15:54 2022] DELETE /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 12:15:54.711710 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-92db78a8-ff10-4da0-8180-a6daac6c54af tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:15:54.712308 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-92db78a8-ff10-4da0-8180-a6daac6c54af tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] [instance: 2f1f910a-6135-426a-97a7-570948cf922c] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:15:54.718849 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-92db78a8-ff10-4da0-8180-a6daac6c54af tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:54.719299 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-92db78a8-ff10-4da0-8180-a6daac6c54af tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:54.719723 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-92db78a8-ff10-4da0-8180-a6daac6c54af tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:54.720376 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-92db78a8-ff10-4da0-8180-a6daac6c54af tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:15:54.720811 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-92db78a8-ff10-4da0-8180-a6daac6c54af tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:15:54.721215 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-92db78a8-ff10-4da0-8180-a6daac6c54af tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:15:54.734229 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.wsgi [None req-92db78a8-ff10-4da0-8180-a6daac6c54af tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] HTTP exception thrown: Instance 2f1f910a-6135-426a-97a7-570948cf922c could not be found. Oct 11 12:15:54.735768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-92db78a8-ff10-4da0-8180-a6daac6c54af tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Request method failure captured: Oct 11 12:15:54.735768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: request: GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c HTTP/1.1 Oct 11 12:15:54.735768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept: application/json Oct 11 12:15:54.735768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept-Encoding: identity Oct 11 12:15:54.735768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Connection: close Oct 11 12:15:54.735768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Length: 0 Oct 11 12:15:54.735768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Type: application/json Oct 11 12:15:54.735768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Host: 10.222.0.59 Oct 11 12:15:54.735768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Openstack-System-Scope: None Oct 11 12:15:54.735768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: User-Agent: python-urllib3/1.26.12 Oct 11 12:15:54.735768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Auth-Token: gAAAAABjRVyOMBKd26owVfU6SSh2w6xAae8qJvUd5mAUTdnNIRwDSx6TAHiasVGas-qC_lxwzPP8nnCxoANLf3SBvIOQlovMeFH1EzwPme9zR6R7OLSyQ-XNd81RFR2CJ0GQsyD5kN1UAPTybpLXawK3rq_7dBEKv7_dBCuh3bN3b4428vp4NbQ Oct 11 12:15:54.735768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Id: None Oct 11 12:15:54.735768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Name: None Oct 11 12:15:54.735768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Identity-Status: Confirmed Oct 11 12:15:54.735768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Is-Admin-Project: True Oct 11 12:15:54.735768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 12:15:54.735768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Id: default Oct 11 12:15:54.735768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Name: Default Oct 11 12:15:54.735768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Id: fee1ecae514e4c79a4f0fe601391971d Oct 11 12:15:54.735768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-857450641 Oct 11 12:15:54.735768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Role: reader,member Oct 11 12:15:54.735768 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Roles: reader,member Oct 11 12:15:54.737463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/fee1ecae514e4c79a4f0fe601391971d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_fee1ecae514e4c79a4f0fe601391971d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fee1ecae514e4c79a4f0fe601391971d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/fee1ecae514e4c79a4f0fe601391971d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:15:54.737463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant: tempest-AttachVolumeShelveTestJSON-857450641 Oct 11 12:15:54.737463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Id: fee1ecae514e4c79a4f0fe601391971d Oct 11 12:15:54.737463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-857450641 Oct 11 12:15:54.737463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User: tempest-AttachVolumeShelveTestJSON-857450641-project Oct 11 12:15:54.737463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Id: default Oct 11 12:15:54.737463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Name: Default Oct 11 12:15:54.737463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Id: abfa19ab0a624de6ab082e8b1e57a220 Oct 11 12:15:54.737463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Name: tempest-AttachVolumeShelveTestJSON-857450641-project Oct 11 12:15:54.737463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: method: > Oct 11 12:15:54.737463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: exception: Instance 2f1f910a-6135-426a-97a7-570948cf922c could not be found. Oct 11 12:15:54.737463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: action_args: {'id': '2f1f910a-6135-426a-97a7-570948cf922c'} Oct 11 12:15:54.738368 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:15:54.738368 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:54.738368 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:15:54.738368 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:15:54.738368 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:15:54.738368 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:15:54.738368 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:15:54.738368 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:15:54.738368 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:15:54.738368 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:15:54.738368 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f1f910a-6135-426a-97a7-570948cf922c could not be found. Oct 11 12:15:54.738368 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:15:54.738368 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:15:54.738368 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:15:54.738368 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:54.738368 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:15:54.738368 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:15:54.738368 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:15:54.738368 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:15:54.738368 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:15:54.739960 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:15:54.739960 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 12:15:54.739960 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 12:15:54.739960 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:15:54.739960 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:15:54.739960 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:15:54.739960 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:15:54.739960 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f1f910a-6135-426a-97a7-570948cf922c could not be found. Oct 11 12:15:54.739960 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:15:54.739960 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:15:54.739960 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:15:54.739960 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:54.739960 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:15:54.739960 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:15:54.739960 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:15:54.739960 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:15:54.739960 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f1f910a-6135-426a-97a7-570948cf922c could not be found. Oct 11 12:15:54.739960 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:15:54.741292 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-92db78a8-ff10-4da0-8180-a6daac6c54af tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] Returning 404 to user: Instance 2f1f910a-6135-426a-97a7-570948cf922c could not be found. {{(pid=118994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:15:54.741292 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-92db78a8-ff10-4da0-8180-a6daac6c54af tempest-AttachVolumeShelveTestJSON-857450641 tempest-AttachVolumeShelveTestJSON-857450641-project] 10.222.0.59 "GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c" status: 404 len: 111 microversion: 2.20 time: 0.029401 Oct 11 12:15:54.741292 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 538/1122] 10.222.0.59 () {60 vars in 1277 bytes} [Tue Oct 11 12:15:54 2022] GET /compute/v2.1/servers/2f1f910a-6135-426a-97a7-570948cf922c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 12:15:58.904119 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-10b33fac-23e3-492a-ac17-31ab9ad4628d tempest-VolumesNegativeTest-1615198371 tempest-VolumesNegativeTest-1615198371-project] Action: 'create', calling method: .version_select at 0x7fd406809820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1646886941", "metadata": {"Type": "work"}}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:15:58.918370 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-10b33fac-23e3-492a-ac17-31ab9ad4628d tempest-VolumesNegativeTest-1615198371 tempest-VolumesNegativeTest-1615198371-project] Request method failure captured: Oct 11 12:15:58.918370 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 11 12:15:58.918370 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 11 12:15:58.918370 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 11 12:15:58.918370 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Connection: close Oct 11 12:15:58.918370 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Length: 122 Oct 11 12:15:58.918370 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 11 12:15:58.918370 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Host: 10.222.0.59 Oct 11 12:15:58.918370 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 11 12:15:58.918370 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 11 12:15:58.918370 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjRV5-12hcXbaq85np_K0uV5EFmFbPzo0JQ36eRQwrHgp8Ze4Em4LUmZ1i0jMCFeb-7cXtB41-4v5-RZkTYO76k70fFwK_P-q44aXUmY8VdTf8UbdpX_rjtmpraynWI3ndtTOomn8MonuURvpgVYyiyuNkd0rwa0YZCXsFZoPzdh0L_RM Oct 11 12:15:58.918370 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 11 12:15:58.918370 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 11 12:15:58.918370 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 11 12:15:58.918370 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 11 12:15:58.918370 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 11 12:15:58.918370 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 11 12:15:58.918370 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Id: 1b6e91ae5ba7427fb12d19ca65ce686e Oct 11 12:15:58.918370 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-VolumesNegativeTest-1615198371 Oct 11 12:15:58.918370 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Role: reader,member Oct 11 12:15:58.918370 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Roles: reader,member Oct 11 12:15:58.920049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1b6e91ae5ba7427fb12d19ca65ce686e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1b6e91ae5ba7427fb12d19ca65ce686e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1b6e91ae5ba7427fb12d19ca65ce686e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1b6e91ae5ba7427fb12d19ca65ce686e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:15:58.920049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-VolumesNegativeTest-1615198371 Oct 11 12:15:58.920049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 1b6e91ae5ba7427fb12d19ca65ce686e Oct 11 12:15:58.920049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-VolumesNegativeTest-1615198371 Oct 11 12:15:58.920049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User: tempest-VolumesNegativeTest-1615198371-project Oct 11 12:15:58.920049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 11 12:15:58.920049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 11 12:15:58.920049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Id: ead246dee1ef40ca92ebaf20186c5b82 Oct 11 12:15:58.920049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-VolumesNegativeTest-1615198371-project Oct 11 12:15:58.920049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Oct 11 12:15:58.920049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1646886941", "metadata": {"Type": "work"}}} Oct 11 12:15:58.920049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: method: Oct 11 12:15:58.920049 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 11 12:15:58.921126 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1646886941', 'metadata': {'Type': 'work'}}}} Oct 11 12:15:58.921126 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:15:58.921126 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:58.921126 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 12:15:58.921126 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 12:15:58.921126 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 12:15:58.921126 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise error Oct 11 12:15:58.921126 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 11 12:15:58.921126 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:58.921126 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 11 12:15:58.921126 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 11 12:15:58.921126 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:58.921126 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 11 12:15:58.921126 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi '#$%' Oct 11 12:15:58.921126 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:58.921126 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:15:58.921126 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:58.921126 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:58.921126 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:15:58.921126 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:15:58.921126 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:15:58.921126 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:15:58.922665 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 12:15:58.922665 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 12:15:58.922665 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:15:58.922665 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:15:58.922665 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 12:15:58.922665 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 12:15:58.922665 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 12:15:58.922665 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 12:15:58.922665 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 12:15:58.922665 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 12:15:58.922665 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 11 12:15:58.922665 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:58.922665 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:15:58.922665 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:58.922665 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:58.922665 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:15:58.922665 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:15:58.922665 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 12:15:58.922665 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 12:15:58.923911 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 11 12:15:58.923911 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:58.923911 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-10b33fac-23e3-492a-ac17-31ab9ad4628d tempest-VolumesNegativeTest-1615198371 tempest-VolumesNegativeTest-1615198371-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:15:58.923911 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-10b33fac-23e3-492a-ac17-31ab9ad4628d tempest-VolumesNegativeTest-1615198371 tempest-VolumesNegativeTest-1615198371-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.136704 Oct 11 12:15:58.923911 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 585/1123] 10.222.0.59 () {60 vars in 1156 bytes} [Tue Oct 11 12:15:58 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 138 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 12:15:58.930942 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-91e74e9a-d47d-49fe-be1e-647cd9057954 tempest-VolumesNegativeTest-1615198371 tempest-VolumesNegativeTest-1615198371-project] Action: 'create', calling method: .version_select at 0x7fd4068234c0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2000557841", "metadata": {"Type": "work"}}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:15:58.935654 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-91e74e9a-d47d-49fe-be1e-647cd9057954 tempest-VolumesNegativeTest-1615198371 tempest-VolumesNegativeTest-1615198371-project] Request method failure captured: Oct 11 12:15:58.935654 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 11 12:15:58.935654 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept: application/json Oct 11 12:15:58.935654 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept-Encoding: identity Oct 11 12:15:58.935654 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Connection: close Oct 11 12:15:58.935654 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Length: 120 Oct 11 12:15:58.935654 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Type: application/json Oct 11 12:15:58.935654 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Host: 10.222.0.59 Oct 11 12:15:58.935654 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Openstack-System-Scope: None Oct 11 12:15:58.935654 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: User-Agent: python-urllib3/1.26.12 Oct 11 12:15:58.935654 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Auth-Token: gAAAAABjRV5-12hcXbaq85np_K0uV5EFmFbPzo0JQ36eRQwrHgp8Ze4Em4LUmZ1i0jMCFeb-7cXtB41-4v5-RZkTYO76k70fFwK_P-q44aXUmY8VdTf8UbdpX_rjtmpraynWI3ndtTOomn8MonuURvpgVYyiyuNkd0rwa0YZCXsFZoPzdh0L_RM Oct 11 12:15:58.935654 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Id: None Oct 11 12:15:58.935654 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Name: None Oct 11 12:15:58.935654 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Identity-Status: Confirmed Oct 11 12:15:58.935654 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Is-Admin-Project: True Oct 11 12:15:58.935654 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Id: default Oct 11 12:15:58.935654 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Name: Default Oct 11 12:15:58.935654 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Id: 1b6e91ae5ba7427fb12d19ca65ce686e Oct 11 12:15:58.935654 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Name: tempest-VolumesNegativeTest-1615198371 Oct 11 12:15:58.935654 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Role: reader,member Oct 11 12:15:58.935654 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Roles: reader,member Oct 11 12:15:58.937272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1b6e91ae5ba7427fb12d19ca65ce686e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1b6e91ae5ba7427fb12d19ca65ce686e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1b6e91ae5ba7427fb12d19ca65ce686e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1b6e91ae5ba7427fb12d19ca65ce686e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:15:58.937272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant: tempest-VolumesNegativeTest-1615198371 Oct 11 12:15:58.937272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Id: 1b6e91ae5ba7427fb12d19ca65ce686e Oct 11 12:15:58.937272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Name: tempest-VolumesNegativeTest-1615198371 Oct 11 12:15:58.937272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User: tempest-VolumesNegativeTest-1615198371-project Oct 11 12:15:58.937272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Id: default Oct 11 12:15:58.937272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Name: Default Oct 11 12:15:58.937272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Id: ead246dee1ef40ca92ebaf20186c5b82 Oct 11 12:15:58.937272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Name: tempest-VolumesNegativeTest-1615198371-project Oct 11 12:15:58.937272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Oct 11 12:15:58.937272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2000557841", "metadata": {"Type": "work"}}} Oct 11 12:15:58.937272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: method: Oct 11 12:15:58.937272 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 11 12:15:58.938429 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2000557841', 'metadata': {'Type': 'work'}}}} Oct 11 12:15:58.938429 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:15:58.938429 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:58.938429 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 12:15:58.938429 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 12:15:58.938429 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 12:15:58.938429 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise error Oct 11 12:15:58.938429 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 11 12:15:58.938429 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:15:58.938429 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 11 12:15:58.938429 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 11 12:15:58.938429 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:15:58.938429 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 11 12:15:58.938429 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi '0' Oct 11 12:15:58.938429 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:15:58.938429 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:15:58.938429 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:15:58.938429 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:58.938429 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:15:58.938429 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:15:58.938429 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:15:58.938429 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:15:58.939998 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 12:15:58.939998 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 12:15:58.939998 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:15:58.939998 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:15:58.939998 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 12:15:58.939998 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 12:15:58.939998 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 12:15:58.939998 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 12:15:58.939998 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 12:15:58.939998 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 12:15:58.939998 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 11 12:15:58.939998 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:15:58.939998 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:15:58.939998 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:15:58.939998 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:58.939998 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:15:58.939998 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:15:58.939998 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 12:15:58.939998 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 12:15:58.941487 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 11 12:15:58.941487 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:15:58.941487 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-91e74e9a-d47d-49fe-be1e-647cd9057954 tempest-VolumesNegativeTest-1615198371 tempest-VolumesNegativeTest-1615198371-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:15:58.941487 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-91e74e9a-d47d-49fe-be1e-647cd9057954 tempest-VolumesNegativeTest-1615198371 tempest-VolumesNegativeTest-1615198371-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009933 Oct 11 12:15:58.941487 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 539/1124] 10.222.0.59 () {60 vars in 1156 bytes} [Tue Oct 11 12:15:58 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 12:15:58.946060 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-691ef715-ddb7-4499-a8c7-4ffd06cea320 tempest-VolumesNegativeTest-1615198371 tempest-VolumesNegativeTest-1615198371-project] Action: 'create', calling method: .version_select at 0x7fd40685dc10>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-607732929", "metadata": {"Type": "work"}}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:15:58.950752 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-691ef715-ddb7-4499-a8c7-4ffd06cea320 tempest-VolumesNegativeTest-1615198371 tempest-VolumesNegativeTest-1615198371-project] Request method failure captured: Oct 11 12:15:58.950752 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 11 12:15:58.950752 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 11 12:15:58.950752 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 11 12:15:58.950752 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Connection: close Oct 11 12:15:58.950752 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Length: 118 Oct 11 12:15:58.950752 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 11 12:15:58.950752 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Host: 10.222.0.59 Oct 11 12:15:58.950752 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 11 12:15:58.950752 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 11 12:15:58.950752 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjRV5-12hcXbaq85np_K0uV5EFmFbPzo0JQ36eRQwrHgp8Ze4Em4LUmZ1i0jMCFeb-7cXtB41-4v5-RZkTYO76k70fFwK_P-q44aXUmY8VdTf8UbdpX_rjtmpraynWI3ndtTOomn8MonuURvpgVYyiyuNkd0rwa0YZCXsFZoPzdh0L_RM Oct 11 12:15:58.950752 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 11 12:15:58.950752 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 11 12:15:58.950752 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 11 12:15:58.950752 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 11 12:15:58.950752 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 11 12:15:58.950752 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 11 12:15:58.950752 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Id: 1b6e91ae5ba7427fb12d19ca65ce686e Oct 11 12:15:58.950752 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-VolumesNegativeTest-1615198371 Oct 11 12:15:58.950752 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Role: reader,member Oct 11 12:15:58.950752 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Roles: reader,member Oct 11 12:15:58.952379 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1b6e91ae5ba7427fb12d19ca65ce686e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1b6e91ae5ba7427fb12d19ca65ce686e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1b6e91ae5ba7427fb12d19ca65ce686e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1b6e91ae5ba7427fb12d19ca65ce686e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:15:58.952379 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-VolumesNegativeTest-1615198371 Oct 11 12:15:58.952379 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 1b6e91ae5ba7427fb12d19ca65ce686e Oct 11 12:15:58.952379 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-VolumesNegativeTest-1615198371 Oct 11 12:15:58.952379 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User: tempest-VolumesNegativeTest-1615198371-project Oct 11 12:15:58.952379 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 11 12:15:58.952379 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 11 12:15:58.952379 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Id: ead246dee1ef40ca92ebaf20186c5b82 Oct 11 12:15:58.952379 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-VolumesNegativeTest-1615198371-project Oct 11 12:15:58.952379 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Oct 11 12:15:58.952379 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-607732929", "metadata": {"Type": "work"}}} Oct 11 12:15:58.952379 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: method: Oct 11 12:15:58.952379 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 11 12:15:58.953509 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-607732929', 'metadata': {'Type': 'work'}}}} Oct 11 12:15:58.953509 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:15:58.953509 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:58.953509 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 12:15:58.953509 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 12:15:58.953509 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 12:15:58.953509 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise error Oct 11 12:15:58.953509 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 11 12:15:58.953509 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:58.953509 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 11 12:15:58.953509 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 11 12:15:58.953509 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:58.953509 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 11 12:15:58.953509 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi '' Oct 11 12:15:58.953509 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:58.953509 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:15:58.953509 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:58.953509 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:58.953509 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:15:58.953509 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:15:58.953509 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:15:58.953509 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:15:58.955331 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 12:15:58.955331 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 12:15:58.955331 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:15:58.955331 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:15:58.955331 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 12:15:58.955331 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 12:15:58.955331 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 12:15:58.955331 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 12:15:58.955331 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 12:15:58.955331 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 12:15:58.955331 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 11 12:15:58.955331 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:58.955331 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:15:58.955331 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:58.955331 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:58.955331 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:15:58.955331 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:15:58.955331 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 12:15:58.955331 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 12:15:58.957031 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 11 12:15:58.957031 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:58.957031 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-691ef715-ddb7-4499-a8c7-4ffd06cea320 tempest-VolumesNegativeTest-1615198371 tempest-VolumesNegativeTest-1615198371-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:15:58.957031 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-691ef715-ddb7-4499-a8c7-4ffd06cea320 tempest-VolumesNegativeTest-1615198371 tempest-VolumesNegativeTest-1615198371-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009775 Oct 11 12:15:58.957031 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 586/1125] 10.222.0.59 () {60 vars in 1156 bytes} [Tue Oct 11 12:15:58 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 12:15:58.961766 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-03d1fd76-84a0-456c-8016-4cd0e5915289 tempest-VolumesNegativeTest-1615198371 tempest-VolumesNegativeTest-1615198371-project] Calling method '.version_select at 0x7fd406a731f0>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:15:58.991055 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.wsgi [None req-03d1fd76-84a0-456c-8016-4cd0e5915289 tempest-VolumesNegativeTest-1615198371 tempest-VolumesNegativeTest-1615198371-project] HTTP exception thrown: Volume tempest-invalid-963873124 could not be found. Oct 11 12:15:58.993044 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-03d1fd76-84a0-456c-8016-4cd0e5915289 tempest-VolumesNegativeTest-1615198371 tempest-VolumesNegativeTest-1615198371-project] Request method failure captured: Oct 11 12:15:58.993044 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-963873124 HTTP/1.1 Oct 11 12:15:58.993044 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept: application/json Oct 11 12:15:58.993044 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept-Encoding: identity Oct 11 12:15:58.993044 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Connection: close Oct 11 12:15:58.993044 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Length: 0 Oct 11 12:15:58.993044 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Type: application/json Oct 11 12:15:58.993044 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Host: 10.222.0.59 Oct 11 12:15:58.993044 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Openstack-System-Scope: None Oct 11 12:15:58.993044 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: User-Agent: python-urllib3/1.26.12 Oct 11 12:15:58.993044 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Auth-Token: gAAAAABjRV5-12hcXbaq85np_K0uV5EFmFbPzo0JQ36eRQwrHgp8Ze4Em4LUmZ1i0jMCFeb-7cXtB41-4v5-RZkTYO76k70fFwK_P-q44aXUmY8VdTf8UbdpX_rjtmpraynWI3ndtTOomn8MonuURvpgVYyiyuNkd0rwa0YZCXsFZoPzdh0L_RM Oct 11 12:15:58.993044 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Id: None Oct 11 12:15:58.993044 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Name: None Oct 11 12:15:58.993044 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Identity-Status: Confirmed Oct 11 12:15:58.993044 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Is-Admin-Project: True Oct 11 12:15:58.993044 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Id: default Oct 11 12:15:58.993044 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Name: Default Oct 11 12:15:58.993044 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Id: 1b6e91ae5ba7427fb12d19ca65ce686e Oct 11 12:15:58.993044 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Name: tempest-VolumesNegativeTest-1615198371 Oct 11 12:15:58.993044 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Role: reader,member Oct 11 12:15:58.993044 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Roles: reader,member Oct 11 12:15:58.994724 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1b6e91ae5ba7427fb12d19ca65ce686e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1b6e91ae5ba7427fb12d19ca65ce686e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1b6e91ae5ba7427fb12d19ca65ce686e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1b6e91ae5ba7427fb12d19ca65ce686e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:15:58.994724 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant: tempest-VolumesNegativeTest-1615198371 Oct 11 12:15:58.994724 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Id: 1b6e91ae5ba7427fb12d19ca65ce686e Oct 11 12:15:58.994724 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Name: tempest-VolumesNegativeTest-1615198371 Oct 11 12:15:58.994724 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User: tempest-VolumesNegativeTest-1615198371-project Oct 11 12:15:58.994724 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Id: default Oct 11 12:15:58.994724 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Name: Default Oct 11 12:15:58.994724 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Id: ead246dee1ef40ca92ebaf20186c5b82 Oct 11 12:15:58.994724 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Name: tempest-VolumesNegativeTest-1615198371-project Oct 11 12:15:58.994724 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: method: Oct 11 12:15:58.994724 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: exception: Volume tempest-invalid-963873124 could not be found. Oct 11 12:15:58.994724 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: action_args: {'id': 'tempest-invalid-963873124'} Oct 11 12:15:58.994724 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:15:58.995645 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:58.995645 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 12:15:58.995645 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 12:15:58.995645 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 12:15:58.995645 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 12:15:58.995645 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 12:15:58.995645 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 12:15:58.995645 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 12:15:58.995645 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 12:15:58.995645 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 12:15:58.995645 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 12:15:58.995645 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 12:15:58.995645 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 12:15:58.995645 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 12:15:58.995645 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 12:15:58.995645 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-963873124 could not be found. (HTTP 404) (Request-ID: req-6c5caad4-e9ea-4aed-9164-d2bb79f54d45) Oct 11 12:15:58.995645 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:15:58.995645 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:15:58.995645 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:15:58.997172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:58.997172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 11 12:15:58.997172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 11 12:15:58.997172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 12:15:58.997172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 12:15:58.997172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 12:15:58.997172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 12:15:58.997172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 12:15:58.997172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 12:15:58.997172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 12:15:58.997172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 12:15:58.997172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 12:15:58.997172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 12:15:58.997172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 12:15:58.997172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 12:15:58.997172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 12:15:58.997172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 12:15:58.997172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 12:15:58.997172 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 12:15:58.998968 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 12:15:58.998968 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 12:15:58.998968 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 12:15:58.998968 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 12:15:58.998968 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-963873124 could not be found. Oct 11 12:15:58.998968 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:15:58.998968 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:15:58.998968 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:15:58.998968 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:58.998968 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:15:58.998968 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:15:58.998968 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:15:58.998968 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:15:58.998968 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 12:15:58.998968 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 12:15:58.998968 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:15:58.998968 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:15:58.998968 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 11 12:15:58.998968 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:15:58.998968 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-963873124 could not be found. Oct 11 12:15:59.000494 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:15:59.000494 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:15:59.000494 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:15:59.000494 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:59.000494 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:15:59.000494 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:15:59.000494 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:15:59.000494 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:15:59.000494 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-963873124 could not be found. Oct 11 12:15:59.000494 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:15:59.000494 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-03d1fd76-84a0-456c-8016-4cd0e5915289 tempest-VolumesNegativeTest-1615198371 tempest-VolumesNegativeTest-1615198371-project] Returning 404 to user: Volume tempest-invalid-963873124 could not be found. {{(pid=118994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:15:59.000494 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-03d1fd76-84a0-456c-8016-4cd0e5915289 tempest-VolumesNegativeTest-1615198371 tempest-VolumesNegativeTest-1615198371-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/tempest-invalid-963873124" status: 404 len: 98 microversion: 2.1 time: 0.037106 Oct 11 12:15:59.000494 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 540/1126] 10.222.0.59 () {58 vars in 1215 bytes} [Tue Oct 11 12:15:58 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-963873124 => generated 98 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 12:15:59.004103 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-14ddc72a-44e6-4a93-a862-d2ca58b38061 tempest-VolumesNegativeTest-1615198371 tempest-VolumesNegativeTest-1615198371-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003771 Oct 11 12:15:59.004597 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 587/1127] 10.222.0.59 () {58 vars in 1140 bytes} [Tue Oct 11 12:15:58 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 11 12:15:59.012625 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-cc6bac08-544b-4087-ad1c-c273d7dec838 tempest-VolumesNegativeTest-1615198371 tempest-VolumesNegativeTest-1615198371-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003759 Oct 11 12:15:59.013106 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 541/1128] 10.222.0.59 () {58 vars in 1137 bytes} [Tue Oct 11 12:15:59 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 11 12:15:59.021083 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-4a9c6d14-d82d-462b-a082-b9ebfb20b798 tempest-VolumesNegativeTest-1615198371 tempest-VolumesNegativeTest-1615198371-project] Calling method '.version_select at 0x7fd406af8e50>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:15:59.049162 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-4a9c6d14-d82d-462b-a082-b9ebfb20b798 tempest-VolumesNegativeTest-1615198371 tempest-VolumesNegativeTest-1615198371-project] HTTP exception thrown: Volume 81e6a9a1-67bb-47b2-bf39-220b85db88af could not be found. Oct 11 12:15:59.051263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-4a9c6d14-d82d-462b-a082-b9ebfb20b798 tempest-VolumesNegativeTest-1615198371 tempest-VolumesNegativeTest-1615198371-project] Request method failure captured: Oct 11 12:15:59.051263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: request: DELETE /compute/v2.1/os-volumes/81e6a9a1-67bb-47b2-bf39-220b85db88af HTTP/1.1 Oct 11 12:15:59.051263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 11 12:15:59.051263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 11 12:15:59.051263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Connection: close Oct 11 12:15:59.051263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 11 12:15:59.051263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 11 12:15:59.051263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Host: 10.222.0.59 Oct 11 12:15:59.051263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 11 12:15:59.051263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 11 12:15:59.051263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjRV5-12hcXbaq85np_K0uV5EFmFbPzo0JQ36eRQwrHgp8Ze4Em4LUmZ1i0jMCFeb-7cXtB41-4v5-RZkTYO76k70fFwK_P-q44aXUmY8VdTf8UbdpX_rjtmpraynWI3ndtTOomn8MonuURvpgVYyiyuNkd0rwa0YZCXsFZoPzdh0L_RM Oct 11 12:15:59.051263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 11 12:15:59.051263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 11 12:15:59.051263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 11 12:15:59.051263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 11 12:15:59.051263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 11 12:15:59.051263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 11 12:15:59.051263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Id: 1b6e91ae5ba7427fb12d19ca65ce686e Oct 11 12:15:59.051263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-VolumesNegativeTest-1615198371 Oct 11 12:15:59.051263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Role: reader,member Oct 11 12:15:59.051263 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Roles: reader,member Oct 11 12:15:59.052829 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1b6e91ae5ba7427fb12d19ca65ce686e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1b6e91ae5ba7427fb12d19ca65ce686e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1b6e91ae5ba7427fb12d19ca65ce686e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1b6e91ae5ba7427fb12d19ca65ce686e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:15:59.052829 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-VolumesNegativeTest-1615198371 Oct 11 12:15:59.052829 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 1b6e91ae5ba7427fb12d19ca65ce686e Oct 11 12:15:59.052829 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-VolumesNegativeTest-1615198371 Oct 11 12:15:59.052829 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User: tempest-VolumesNegativeTest-1615198371-project Oct 11 12:15:59.052829 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 11 12:15:59.052829 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 11 12:15:59.052829 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Id: ead246dee1ef40ca92ebaf20186c5b82 Oct 11 12:15:59.052829 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-VolumesNegativeTest-1615198371-project Oct 11 12:15:59.052829 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: method: Oct 11 12:15:59.052829 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: exception: Volume 81e6a9a1-67bb-47b2-bf39-220b85db88af could not be found. Oct 11 12:15:59.052829 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: action_args: {'id': '81e6a9a1-67bb-47b2-bf39-220b85db88af'} Oct 11 12:15:59.052829 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:15:59.053971 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:59.053971 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 12:15:59.053971 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 12:15:59.053971 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 12:15:59.053971 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 12:15:59.053971 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 12:15:59.053971 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 12:15:59.053971 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 12:15:59.053971 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 12:15:59.053971 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 12:15:59.053971 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 12:15:59.053971 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 12:15:59.053971 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 12:15:59.053971 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 12:15:59.053971 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 12:15:59.053971 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 81e6a9a1-67bb-47b2-bf39-220b85db88af could not be found. (HTTP 404) (Request-ID: req-29a64014-1f7d-4c81-8681-c29a6075689d) Oct 11 12:15:59.053971 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:59.053971 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:15:59.053971 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:59.055405 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:59.055405 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 11 12:15:59.055405 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 11 12:15:59.055405 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 12:15:59.055405 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 12:15:59.055405 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 12:15:59.055405 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 12:15:59.055405 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 12:15:59.055405 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 12:15:59.055405 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 12:15:59.055405 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 12:15:59.055405 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 12:15:59.055405 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 12:15:59.055405 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 12:15:59.055405 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 12:15:59.055405 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 12:15:59.055405 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 12:15:59.055405 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 12:15:59.055405 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 12:15:59.056859 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 12:15:59.056859 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 12:15:59.056859 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 12:15:59.056859 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 12:15:59.056859 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 81e6a9a1-67bb-47b2-bf39-220b85db88af could not be found. Oct 11 12:15:59.056859 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:59.056859 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:15:59.056859 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:59.056859 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:59.056859 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:15:59.056859 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:15:59.056859 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:15:59.056859 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:15:59.056859 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 12:15:59.056859 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 12:15:59.056859 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:15:59.056859 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:15:59.056859 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 11 12:15:59.056859 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:15:59.058375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 81e6a9a1-67bb-47b2-bf39-220b85db88af could not be found. Oct 11 12:15:59.058375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:59.058375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:15:59.058375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:59.058375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:59.058375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:15:59.058375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:15:59.058375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:15:59.058375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:15:59.058375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 81e6a9a1-67bb-47b2-bf39-220b85db88af could not be found. Oct 11 12:15:59.058375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:15:59.058375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-4a9c6d14-d82d-462b-a082-b9ebfb20b798 tempest-VolumesNegativeTest-1615198371 tempest-VolumesNegativeTest-1615198371-project] Returning 404 to user: Volume 81e6a9a1-67bb-47b2-bf39-220b85db88af could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:15:59.058375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-4a9c6d14-d82d-462b-a082-b9ebfb20b798 tempest-VolumesNegativeTest-1615198371 tempest-VolumesNegativeTest-1615198371-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/81e6a9a1-67bb-47b2-bf39-220b85db88af" status: 404 len: 109 microversion: 2.1 time: 0.035391 Oct 11 12:15:59.058375 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 588/1129] 10.222.0.59 () {58 vars in 1248 bytes} [Tue Oct 11 12:15:59 2022] DELETE /compute/v2.1/os-volumes/81e6a9a1-67bb-47b2-bf39-220b85db88af => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:15:59.062147 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-21038795-59cd-4b23-8775-6e5d1a1a0ea9 tempest-VolumesNegativeTest-1615198371 tempest-VolumesNegativeTest-1615198371-project] Calling method '.version_select at 0x7fd4066ced30>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:15:59.093109 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.wsgi [None req-21038795-59cd-4b23-8775-6e5d1a1a0ea9 tempest-VolumesNegativeTest-1615198371 tempest-VolumesNegativeTest-1615198371-project] HTTP exception thrown: Volume b3369536-eb1d-42ad-9f81-526cac342719 could not be found. Oct 11 12:15:59.096300 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-21038795-59cd-4b23-8775-6e5d1a1a0ea9 tempest-VolumesNegativeTest-1615198371 tempest-VolumesNegativeTest-1615198371-project] Request method failure captured: Oct 11 12:15:59.096300 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: request: GET /compute/v2.1/os-volumes/b3369536-eb1d-42ad-9f81-526cac342719 HTTP/1.1 Oct 11 12:15:59.096300 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept: application/json Oct 11 12:15:59.096300 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept-Encoding: identity Oct 11 12:15:59.096300 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Connection: close Oct 11 12:15:59.096300 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Length: 0 Oct 11 12:15:59.096300 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Type: application/json Oct 11 12:15:59.096300 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Host: 10.222.0.59 Oct 11 12:15:59.096300 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Openstack-System-Scope: None Oct 11 12:15:59.096300 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: User-Agent: python-urllib3/1.26.12 Oct 11 12:15:59.096300 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Auth-Token: gAAAAABjRV5-12hcXbaq85np_K0uV5EFmFbPzo0JQ36eRQwrHgp8Ze4Em4LUmZ1i0jMCFeb-7cXtB41-4v5-RZkTYO76k70fFwK_P-q44aXUmY8VdTf8UbdpX_rjtmpraynWI3ndtTOomn8MonuURvpgVYyiyuNkd0rwa0YZCXsFZoPzdh0L_RM Oct 11 12:15:59.096300 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Id: None Oct 11 12:15:59.096300 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Name: None Oct 11 12:15:59.096300 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Identity-Status: Confirmed Oct 11 12:15:59.096300 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Is-Admin-Project: True Oct 11 12:15:59.096300 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Id: default Oct 11 12:15:59.096300 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Name: Default Oct 11 12:15:59.096300 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Id: 1b6e91ae5ba7427fb12d19ca65ce686e Oct 11 12:15:59.096300 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Name: tempest-VolumesNegativeTest-1615198371 Oct 11 12:15:59.096300 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Role: reader,member Oct 11 12:15:59.096300 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Roles: reader,member Oct 11 12:15:59.098892 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1b6e91ae5ba7427fb12d19ca65ce686e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1b6e91ae5ba7427fb12d19ca65ce686e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1b6e91ae5ba7427fb12d19ca65ce686e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1b6e91ae5ba7427fb12d19ca65ce686e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:15:59.098892 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant: tempest-VolumesNegativeTest-1615198371 Oct 11 12:15:59.098892 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Id: 1b6e91ae5ba7427fb12d19ca65ce686e Oct 11 12:15:59.098892 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Name: tempest-VolumesNegativeTest-1615198371 Oct 11 12:15:59.098892 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User: tempest-VolumesNegativeTest-1615198371-project Oct 11 12:15:59.098892 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Id: default Oct 11 12:15:59.098892 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Name: Default Oct 11 12:15:59.098892 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Id: ead246dee1ef40ca92ebaf20186c5b82 Oct 11 12:15:59.098892 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Name: tempest-VolumesNegativeTest-1615198371-project Oct 11 12:15:59.098892 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: method: Oct 11 12:15:59.098892 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: exception: Volume b3369536-eb1d-42ad-9f81-526cac342719 could not be found. Oct 11 12:15:59.098892 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: action_args: {'id': 'b3369536-eb1d-42ad-9f81-526cac342719'} Oct 11 12:15:59.098892 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:15:59.100553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:59.100553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 12:15:59.100553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 12:15:59.100553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 12:15:59.100553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 12:15:59.100553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 12:15:59.100553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 12:15:59.100553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 12:15:59.100553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 12:15:59.100553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 12:15:59.100553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 12:15:59.100553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 12:15:59.100553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 12:15:59.100553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 12:15:59.100553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 12:15:59.100553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b3369536-eb1d-42ad-9f81-526cac342719 could not be found. (HTTP 404) (Request-ID: req-2877e5bc-3a76-4c7d-b9d2-8af7c6401ff5) Oct 11 12:15:59.100553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:15:59.100553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:15:59.100553 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:15:59.102883 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:59.102883 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 11 12:15:59.102883 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 11 12:15:59.102883 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 12:15:59.102883 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 12:15:59.102883 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 12:15:59.102883 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 12:15:59.102883 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 12:15:59.102883 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 12:15:59.102883 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 12:15:59.102883 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 12:15:59.102883 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 12:15:59.102883 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 12:15:59.102883 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 12:15:59.102883 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 12:15:59.102883 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 12:15:59.102883 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 12:15:59.102883 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 12:15:59.102883 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 12:15:59.106644 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 12:15:59.106644 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 12:15:59.106644 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 12:15:59.106644 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 12:15:59.106644 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b3369536-eb1d-42ad-9f81-526cac342719 could not be found. Oct 11 12:15:59.106644 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:15:59.106644 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:15:59.106644 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:15:59.106644 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:59.106644 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:15:59.106644 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:15:59.106644 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:15:59.106644 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:15:59.106644 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 12:15:59.106644 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 12:15:59.106644 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:15:59.106644 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:15:59.106644 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 11 12:15:59.106644 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:15:59.108924 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b3369536-eb1d-42ad-9f81-526cac342719 could not be found. Oct 11 12:15:59.108924 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:15:59.108924 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:15:59.108924 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:15:59.108924 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:15:59.108924 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:15:59.108924 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:15:59.108924 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:15:59.108924 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:15:59.108924 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b3369536-eb1d-42ad-9f81-526cac342719 could not be found. Oct 11 12:15:59.108924 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:15:59.108924 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-21038795-59cd-4b23-8775-6e5d1a1a0ea9 tempest-VolumesNegativeTest-1615198371 tempest-VolumesNegativeTest-1615198371-project] Returning 404 to user: Volume b3369536-eb1d-42ad-9f81-526cac342719 could not be found. {{(pid=118994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:15:59.108924 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-21038795-59cd-4b23-8775-6e5d1a1a0ea9 tempest-VolumesNegativeTest-1615198371 tempest-VolumesNegativeTest-1615198371-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/b3369536-eb1d-42ad-9f81-526cac342719" status: 404 len: 109 microversion: 2.1 time: 0.039767 Oct 11 12:15:59.108924 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 542/1130] 10.222.0.59 () {58 vars in 1245 bytes} [Tue Oct 11 12:15:59 2022] GET /compute/v2.1/os-volumes/b3369536-eb1d-42ad-9f81-526cac342719 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:16:01.491861 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-02d8ffd9-fd40-4ac8-925b-c909b5ada52a tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:16:01.492431 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-02d8ffd9-fd40-4ac8-925b-c909b5ada52a tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 2f69fb21-4f8a-43d4-a5b9-fb52bab23576] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:16:01.498778 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-02d8ffd9-fd40-4ac8-925b-c909b5ada52a tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:01.499265 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-02d8ffd9-fd40-4ac8-925b-c909b5ada52a tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:01.499692 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-02d8ffd9-fd40-4ac8-925b-c909b5ada52a tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:01.500407 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-02d8ffd9-fd40-4ac8-925b-c909b5ada52a tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:01.500853 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-02d8ffd9-fd40-4ac8-925b-c909b5ada52a tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:01.501268 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-02d8ffd9-fd40-4ac8-925b-c909b5ada52a tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:01.525973 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-02d8ffd9-fd40-4ac8-925b-c909b5ada52a tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 2f69fb21-4f8a-43d4-a5b9-fb52bab23576] Going to try to terminate instance {{(pid=118995) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 12:16:01.611657 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-02d8ffd9-fd40-4ac8-925b-c909b5ada52a tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576" status: 204 len: 0 microversion: 2.1 time: 0.124716 Oct 11 12:16:01.612477 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 589/1131] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Oct 11 12:16:01 2022] DELETE /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 12:16:01.622953 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-ae36e59d-f4b3-47a3-86ec-e060f7014ece tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:16:01.623565 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-ae36e59d-f4b3-47a3-86ec-e060f7014ece tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 2f69fb21-4f8a-43d4-a5b9-fb52bab23576] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:16:01.630383 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ae36e59d-f4b3-47a3-86ec-e060f7014ece tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:01.630975 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ae36e59d-f4b3-47a3-86ec-e060f7014ece tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:01.631548 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ae36e59d-f4b3-47a3-86ec-e060f7014ece tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:01.632529 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ae36e59d-f4b3-47a3-86ec-e060f7014ece tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:01.633030 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ae36e59d-f4b3-47a3-86ec-e060f7014ece tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:01.633504 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ae36e59d-f4b3-47a3-86ec-e060f7014ece tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:01.777737 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-ae36e59d-f4b3-47a3-86ec-e060f7014ece tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:16:01.786140 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-ae36e59d-f4b3-47a3-86ec-e060f7014ece tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576" status: 200 len: 1575 microversion: 2.1 time: 0.169471 Oct 11 12:16:01.786735 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 543/1132] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:16:01 2022] GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:16:02.815229 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9541cdfd-47ba-4ce8-86b0-32613a9f4bdc tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:16:02.816343 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9541cdfd-47ba-4ce8-86b0-32613a9f4bdc tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 2f69fb21-4f8a-43d4-a5b9-fb52bab23576] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:16:02.827276 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9541cdfd-47ba-4ce8-86b0-32613a9f4bdc tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:02.828064 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9541cdfd-47ba-4ce8-86b0-32613a9f4bdc tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:02.828783 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9541cdfd-47ba-4ce8-86b0-32613a9f4bdc tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:02.829920 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9541cdfd-47ba-4ce8-86b0-32613a9f4bdc tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:02.830701 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9541cdfd-47ba-4ce8-86b0-32613a9f4bdc tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:02.831402 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9541cdfd-47ba-4ce8-86b0-32613a9f4bdc tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:02.974018 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-9541cdfd-47ba-4ce8-86b0-32613a9f4bdc tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:16:02.986623 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9541cdfd-47ba-4ce8-86b0-32613a9f4bdc tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576" status: 200 len: 1575 microversion: 2.1 time: 0.178437 Oct 11 12:16:02.987556 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 590/1133] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:16:02 2022] GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576 => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:16:04.010154 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-3140a7f7-d048-44ee-8366-70560ea37aaf tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:16:04.010874 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-3140a7f7-d048-44ee-8366-70560ea37aaf tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 2f69fb21-4f8a-43d4-a5b9-fb52bab23576] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:16:04.017868 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3140a7f7-d048-44ee-8366-70560ea37aaf tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:04.018350 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3140a7f7-d048-44ee-8366-70560ea37aaf tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:04.018808 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3140a7f7-d048-44ee-8366-70560ea37aaf tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:04.019496 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3140a7f7-d048-44ee-8366-70560ea37aaf tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:04.020248 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3140a7f7-d048-44ee-8366-70560ea37aaf tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:04.020667 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3140a7f7-d048-44ee-8366-70560ea37aaf tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:04.082238 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-3140a7f7-d048-44ee-8366-70560ea37aaf tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:16:04.090311 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-3140a7f7-d048-44ee-8366-70560ea37aaf tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576" status: 200 len: 1507 microversion: 2.1 time: 0.084097 Oct 11 12:16:04.090878 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 544/1134] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:16:04 2022] GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576 => generated 1507 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:16:04.634254 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-cc92217b-c421-460b-827e-075b6e8d413a req-5085191e-d689-447a-b84b-e1da76c14b77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f69fb21-4f8a-43d4-a5b9-fb52bab23576", "name": "network-vif-deleted", "tag": "561b9fa3-a590-499e-8240-53039a11fd5f"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:16:04.644400 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-cc92217b-c421-460b-827e-075b6e8d413a req-5085191e-d689-447a-b84b-e1da76c14b77 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:04.645528 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-cc92217b-c421-460b-827e-075b6e8d413a req-5085191e-d689-447a-b84b-e1da76c14b77 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:04.645954 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-cc92217b-c421-460b-827e-075b6e8d413a req-5085191e-d689-447a-b84b-e1da76c14b77 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:04.657930 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-cc92217b-c421-460b-827e-075b6e8d413a req-5085191e-d689-447a-b84b-e1da76c14b77 service nova] Creating event network-vif-deleted:561b9fa3-a590-499e-8240-53039a11fd5f for instance 2f69fb21-4f8a-43d4-a5b9-fb52bab23576 on hv-cinder-82099 Oct 11 12:16:04.663154 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-cc92217b-c421-460b-827e-075b6e8d413a req-5085191e-d689-447a-b84b-e1da76c14b77 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157153 Oct 11 12:16:04.663724 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 591/1135] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:16:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:16:05.117162 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-7b5cb605-2a88-4e96-9380-5e7c91d9e12e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:16:05.118271 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-7b5cb605-2a88-4e96-9380-5e7c91d9e12e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 2f69fb21-4f8a-43d4-a5b9-fb52bab23576] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:16:05.134091 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7b5cb605-2a88-4e96-9380-5e7c91d9e12e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:05.134622 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7b5cb605-2a88-4e96-9380-5e7c91d9e12e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:05.135058 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7b5cb605-2a88-4e96-9380-5e7c91d9e12e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:05.135989 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7b5cb605-2a88-4e96-9380-5e7c91d9e12e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:05.136503 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7b5cb605-2a88-4e96-9380-5e7c91d9e12e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:05.136785 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7b5cb605-2a88-4e96-9380-5e7c91d9e12e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:05.168934 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7b5cb605-2a88-4e96-9380-5e7c91d9e12e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:05.169973 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7b5cb605-2a88-4e96-9380-5e7c91d9e12e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:05.170903 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7b5cb605-2a88-4e96-9380-5e7c91d9e12e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:05.170903 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.objects.instance [None req-7b5cb605-2a88-4e96-9380-5e7c91d9e12e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lazy-loading 'fault' on Instance uuid 2f69fb21-4f8a-43d4-a5b9-fb52bab23576 {{(pid=118994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 12:16:05.222813 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-7b5cb605-2a88-4e96-9380-5e7c91d9e12e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:16:05.232627 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-7b5cb605-2a88-4e96-9380-5e7c91d9e12e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576" status: 200 len: 1229 microversion: 2.1 time: 0.122347 Oct 11 12:16:05.233380 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 545/1136] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:16:05 2022] GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576 => generated 1229 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:16:06.263379 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e9932f34-bb99-48be-a10a-0c4b34592ebe tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:16:06.263928 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-e9932f34-bb99-48be-a10a-0c4b34592ebe tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 2f69fb21-4f8a-43d4-a5b9-fb52bab23576] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:16:06.271012 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e9932f34-bb99-48be-a10a-0c4b34592ebe tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:06.271486 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e9932f34-bb99-48be-a10a-0c4b34592ebe tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:06.271914 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e9932f34-bb99-48be-a10a-0c4b34592ebe tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:06.272586 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e9932f34-bb99-48be-a10a-0c4b34592ebe tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:06.273030 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e9932f34-bb99-48be-a10a-0c4b34592ebe tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:06.273446 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-e9932f34-bb99-48be-a10a-0c4b34592ebe tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:06.286938 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-e9932f34-bb99-48be-a10a-0c4b34592ebe tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] HTTP exception thrown: Instance 2f69fb21-4f8a-43d4-a5b9-fb52bab23576 could not be found. Oct 11 12:16:06.288548 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e9932f34-bb99-48be-a10a-0c4b34592ebe tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Request method failure captured: Oct 11 12:16:06.288548 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576 HTTP/1.1 Oct 11 12:16:06.288548 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 11 12:16:06.288548 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 11 12:16:06.288548 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Connection: close Oct 11 12:16:06.288548 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 11 12:16:06.288548 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 11 12:16:06.288548 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Host: 10.222.0.59 Oct 11 12:16:06.288548 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 11 12:16:06.288548 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 11 12:16:06.288548 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjRV3B3Ze2uMjiHad5GYeO-UuPwIbvGl7_ItGEygJinfPbqd63zqUFbzq4h6lT2072e_nEWiV9vy1oWj6HwkQ25mu5eDMXbJl4e6yTq2w79o-ctUFK8rr9ARidvk5gzBS09zXWOdfB8T4j29naGWXC0wC_gE7F01RblioUVP8TW3NFGm8 Oct 11 12:16:06.288548 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 11 12:16:06.288548 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 11 12:16:06.288548 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 11 12:16:06.288548 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 11 12:16:06.288548 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 11 12:16:06.288548 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 11 12:16:06.288548 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Id: 4f2eaa1959394ae3a4b4b27d00b917d1 Oct 11 12:16:06.288548 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-TestVolumeBootPattern-945275872 Oct 11 12:16:06.288548 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Role: reader,member Oct 11 12:16:06.288548 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Roles: reader,member Oct 11 12:16:06.290137 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4f2eaa1959394ae3a4b4b27d00b917d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4f2eaa1959394ae3a4b4b27d00b917d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f2eaa1959394ae3a4b4b27d00b917d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f2eaa1959394ae3a4b4b27d00b917d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:16:06.290137 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-TestVolumeBootPattern-945275872 Oct 11 12:16:06.290137 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 4f2eaa1959394ae3a4b4b27d00b917d1 Oct 11 12:16:06.290137 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-TestVolumeBootPattern-945275872 Oct 11 12:16:06.290137 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User: tempest-TestVolumeBootPattern-945275872-project Oct 11 12:16:06.290137 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 11 12:16:06.290137 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 11 12:16:06.290137 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Id: 82c54e3aa3aa46a28373acb91f32cc9a Oct 11 12:16:06.290137 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-TestVolumeBootPattern-945275872-project Oct 11 12:16:06.290137 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: method: > Oct 11 12:16:06.290137 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: exception: Instance 2f69fb21-4f8a-43d4-a5b9-fb52bab23576 could not be found. Oct 11 12:16:06.290137 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: action_args: {'id': '2f69fb21-4f8a-43d4-a5b9-fb52bab23576'} Oct 11 12:16:06.291086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:16:06.291086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:16:06.291086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:16:06.291086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:16:06.291086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:16:06.291086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:16:06.291086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:16:06.291086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:16:06.291086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:16:06.291086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:16:06.291086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f69fb21-4f8a-43d4-a5b9-fb52bab23576 could not be found. Oct 11 12:16:06.291086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:16:06.291086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:16:06.291086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:16:06.291086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:16:06.291086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:16:06.291086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:16:06.291086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:16:06.291086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:16:06.291086 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:16:06.292585 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:16:06.292585 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 12:16:06.292585 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 12:16:06.292585 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:16:06.292585 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:16:06.292585 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:16:06.292585 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:16:06.292585 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f69fb21-4f8a-43d4-a5b9-fb52bab23576 could not be found. Oct 11 12:16:06.292585 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:16:06.292585 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:16:06.292585 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:16:06.292585 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:16:06.292585 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:16:06.292585 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:16:06.292585 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:16:06.292585 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:16:06.292585 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f69fb21-4f8a-43d4-a5b9-fb52bab23576 could not be found. Oct 11 12:16:06.292585 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:16:06.294005 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-e9932f34-bb99-48be-a10a-0c4b34592ebe tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Returning 404 to user: Instance 2f69fb21-4f8a-43d4-a5b9-fb52bab23576 could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:16:06.294005 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-e9932f34-bb99-48be-a10a-0c4b34592ebe tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576" status: 404 len: 111 microversion: 2.1 time: 0.033682 Oct 11 12:16:06.294005 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 592/1137] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:16:06 2022] GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:16:06.388371 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-024af90b-73c8-406d-9048-2797b8655879 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1917921540", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-79745519", "security_groups": [{"name": "tempest-secgroup-smoke-1304625771"}], "block_device_mapping_v2": [{"uuid": "1b302021-0674-4463-94be-cc56a25169ed", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "86bc98a2-e857-47e1-8cc0-6c28f4d3763e"}]}} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:16:06.503239 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.network.neutron [None req-024af90b-73c8-406d-9048-2797b8655879 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] validate_networks() for [('86bc98a2-e857-47e1-8cc0-6c28f4d3763e', None, None, None, None, None)] {{(pid=118994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 12:16:06.879029 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-024af90b-73c8-406d-9048-2797b8655879 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Flavor limits 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 12:16:06.879583 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-024af90b-73c8-406d-9048-2797b8655879 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Image limits 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 12:16:06.880057 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-024af90b-73c8-406d-9048-2797b8655879 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Flavor pref 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 12:16:06.880492 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-024af90b-73c8-406d-9048-2797b8655879 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Image pref 0:0:0 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 12:16:06.880902 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.virt.hardware [None req-024af90b-73c8-406d-9048-2797b8655879 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 12:16:06.890072 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-024af90b-73c8-406d-9048-2797b8655879 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:06.890639 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-024af90b-73c8-406d-9048-2797b8655879 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:06.891029 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-024af90b-73c8-406d-9048-2797b8655879 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:06.891757 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-024af90b-73c8-406d-9048-2797b8655879 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:06.892209 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-024af90b-73c8-406d-9048-2797b8655879 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:06.892643 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-024af90b-73c8-406d-9048-2797b8655879 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:06.909654 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-024af90b-73c8-406d-9048-2797b8655879 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Getting quotas for project 4f2eaa1959394ae3a4b4b27d00b917d1. Resources: {'ram', 'instances', 'cores'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 12:16:06.913694 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.quota [None req-024af90b-73c8-406d-9048-2797b8655879 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Getting quotas for user 82c54e3aa3aa46a28373acb91f32cc9a and project 4f2eaa1959394ae3a4b4b27d00b917d1. Resources: {'ram', 'instances', 'cores'} {{(pid=118994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 12:16:06.972121 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-024af90b-73c8-406d-9048-2797b8655879 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Going to run 1 instances... {{(pid=118994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 12:16:06.974321 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-024af90b-73c8-406d-9048-2797b8655879 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 38015aaa-72c1-420e-95bd-596e493b6e87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1b302021-0674-4463-94be-cc56a25169ed',volume_size=None,volume_type=None)] {{(pid=118994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 12:16:07.112726 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-024af90b-73c8-406d-9048-2797b8655879 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.728267 Oct 11 12:16:07.113374 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 546/1138] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Oct 11 12:16:06 2022] POST /compute/v2.1/servers => generated 406 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 12:16:07.124982 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-1b5d232b-7e70-407a-b14d-31cfa6df9380 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:16:07.125750 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-1b5d232b-7e70-407a-b14d-31cfa6df9380 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 38015aaa-72c1-420e-95bd-596e493b6e87] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:16:07.180572 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-1b5d232b-7e70-407a-b14d-31cfa6df9380 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:16:07.187922 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-1b5d232b-7e70-407a-b14d-31cfa6df9380 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87" status: 200 len: 1093 microversion: 2.1 time: 0.066917 Oct 11 12:16:07.188503 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 593/1139] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:16:07 2022] GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87 => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:16:08.212741 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-7e2872c2-4265-4a0a-8f6d-acd998548da0 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:16:08.214098 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-7e2872c2-4265-4a0a-8f6d-acd998548da0 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 38015aaa-72c1-420e-95bd-596e493b6e87] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:16:08.221472 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7e2872c2-4265-4a0a-8f6d-acd998548da0 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:08.222833 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7e2872c2-4265-4a0a-8f6d-acd998548da0 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:08.223708 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7e2872c2-4265-4a0a-8f6d-acd998548da0 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:08.224969 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7e2872c2-4265-4a0a-8f6d-acd998548da0 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:08.225899 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7e2872c2-4265-4a0a-8f6d-acd998548da0 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:08.226359 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-7e2872c2-4265-4a0a-8f6d-acd998548da0 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:08.298508 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-7e2872c2-4265-4a0a-8f6d-acd998548da0 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:16:08.306721 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-7e2872c2-4265-4a0a-8f6d-acd998548da0 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87" status: 200 len: 1209 microversion: 2.1 time: 0.099924 Oct 11 12:16:08.307373 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 547/1140] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:16:08 2022] GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87 => generated 1209 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:16:09.331790 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-2a5b9ef6-b4ab-4a39-8940-b97620a0117e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:16:09.332384 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-2a5b9ef6-b4ab-4a39-8940-b97620a0117e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 38015aaa-72c1-420e-95bd-596e493b6e87] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:16:09.339579 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2a5b9ef6-b4ab-4a39-8940-b97620a0117e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:09.340292 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2a5b9ef6-b4ab-4a39-8940-b97620a0117e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:09.340713 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2a5b9ef6-b4ab-4a39-8940-b97620a0117e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:09.341432 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2a5b9ef6-b4ab-4a39-8940-b97620a0117e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:09.341880 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2a5b9ef6-b4ab-4a39-8940-b97620a0117e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:09.342284 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-2a5b9ef6-b4ab-4a39-8940-b97620a0117e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:09.585073 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-2a5b9ef6-b4ab-4a39-8940-b97620a0117e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:16:09.595891 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-2a5b9ef6-b4ab-4a39-8940-b97620a0117e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87" status: 200 len: 1265 microversion: 2.1 time: 0.268697 Oct 11 12:16:09.611248 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 594/1141] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:16:09 2022] GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87 => generated 1265 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:16:09.753461 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-9d3c2a70-c29e-4cc2-849f-5c2f5c8c016e req-10374300-16da-47d1-91f0-d95f8e8939ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38015aaa-72c1-420e-95bd-596e493b6e87", "tag": "98448cdf-7d5c-4dc2-9447-c9b25ebcaea1"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:16:09.763767 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-9d3c2a70-c29e-4cc2-849f-5c2f5c8c016e req-10374300-16da-47d1-91f0-d95f8e8939ff service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:09.764407 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-9d3c2a70-c29e-4cc2-849f-5c2f5c8c016e req-10374300-16da-47d1-91f0-d95f8e8939ff service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:09.764659 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-9d3c2a70-c29e-4cc2-849f-5c2f5c8c016e req-10374300-16da-47d1-91f0-d95f8e8939ff service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:09.777794 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-9d3c2a70-c29e-4cc2-849f-5c2f5c8c016e req-10374300-16da-47d1-91f0-d95f8e8939ff service nova] Creating event network-changed:98448cdf-7d5c-4dc2-9447-c9b25ebcaea1 for instance 38015aaa-72c1-420e-95bd-596e493b6e87 on hv-cinder-82099 Oct 11 12:16:09.782803 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-9d3c2a70-c29e-4cc2-849f-5c2f5c8c016e req-10374300-16da-47d1-91f0-d95f8e8939ff service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033056 Oct 11 12:16:09.783393 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 548/1142] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:16:10.625234 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-693e4d9d-3bd4-4ad7-86f6-01404aff7742 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:16:10.626318 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-693e4d9d-3bd4-4ad7-86f6-01404aff7742 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 38015aaa-72c1-420e-95bd-596e493b6e87] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:16:10.637053 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-693e4d9d-3bd4-4ad7-86f6-01404aff7742 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:10.637174 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-693e4d9d-3bd4-4ad7-86f6-01404aff7742 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:10.637540 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-693e4d9d-3bd4-4ad7-86f6-01404aff7742 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:10.638220 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-693e4d9d-3bd4-4ad7-86f6-01404aff7742 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:10.638687 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-693e4d9d-3bd4-4ad7-86f6-01404aff7742 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:10.639084 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-693e4d9d-3bd4-4ad7-86f6-01404aff7742 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:10.776182 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-693e4d9d-3bd4-4ad7-86f6-01404aff7742 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:16:10.783877 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-693e4d9d-3bd4-4ad7-86f6-01404aff7742 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87" status: 200 len: 1265 microversion: 2.1 time: 0.165177 Oct 11 12:16:10.784428 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 595/1143] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:16:10 2022] GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:16:11.808211 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-774dc810-7dff-4253-b7c3-006dd9a18f44 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:16:11.809122 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-774dc810-7dff-4253-b7c3-006dd9a18f44 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 38015aaa-72c1-420e-95bd-596e493b6e87] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:16:11.815632 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-774dc810-7dff-4253-b7c3-006dd9a18f44 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:11.816108 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-774dc810-7dff-4253-b7c3-006dd9a18f44 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:11.816539 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-774dc810-7dff-4253-b7c3-006dd9a18f44 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:11.817267 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-774dc810-7dff-4253-b7c3-006dd9a18f44 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:11.817701 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-774dc810-7dff-4253-b7c3-006dd9a18f44 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:11.818116 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-774dc810-7dff-4253-b7c3-006dd9a18f44 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:11.952295 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-774dc810-7dff-4253-b7c3-006dd9a18f44 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:16:11.960141 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-774dc810-7dff-4253-b7c3-006dd9a18f44 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87" status: 200 len: 1265 microversion: 2.1 time: 0.156913 Oct 11 12:16:11.960688 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 549/1144] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:16:11 2022] GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:16:12.984161 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-603b142c-cf7e-45d8-8e94-4d626cb1de96 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:16:12.984752 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-603b142c-cf7e-45d8-8e94-4d626cb1de96 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 38015aaa-72c1-420e-95bd-596e493b6e87] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:16:12.991678 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-603b142c-cf7e-45d8-8e94-4d626cb1de96 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:12.992150 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-603b142c-cf7e-45d8-8e94-4d626cb1de96 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:12.992568 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-603b142c-cf7e-45d8-8e94-4d626cb1de96 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:12.993242 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-603b142c-cf7e-45d8-8e94-4d626cb1de96 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:12.993682 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-603b142c-cf7e-45d8-8e94-4d626cb1de96 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:12.994092 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-603b142c-cf7e-45d8-8e94-4d626cb1de96 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:13.132419 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-603b142c-cf7e-45d8-8e94-4d626cb1de96 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:16:13.140883 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-603b142c-cf7e-45d8-8e94-4d626cb1de96 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87" status: 200 len: 1265 microversion: 2.1 time: 0.160956 Oct 11 12:16:13.141451 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 596/1145] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:16:12 2022] GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:16:14.168508 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-38a0e1cd-b980-4cf9-84ee-e2d2bb22db57 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:16:14.169439 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-38a0e1cd-b980-4cf9-84ee-e2d2bb22db57 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 38015aaa-72c1-420e-95bd-596e493b6e87] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:16:14.180143 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-38a0e1cd-b980-4cf9-84ee-e2d2bb22db57 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:14.181945 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-38a0e1cd-b980-4cf9-84ee-e2d2bb22db57 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:14.182804 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-38a0e1cd-b980-4cf9-84ee-e2d2bb22db57 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:14.183937 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-38a0e1cd-b980-4cf9-84ee-e2d2bb22db57 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:14.184397 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-38a0e1cd-b980-4cf9-84ee-e2d2bb22db57 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:14.184818 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-38a0e1cd-b980-4cf9-84ee-e2d2bb22db57 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:14.330419 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-38a0e1cd-b980-4cf9-84ee-e2d2bb22db57 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:16:14.342346 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-38a0e1cd-b980-4cf9-84ee-e2d2bb22db57 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87" status: 200 len: 1265 microversion: 2.1 time: 0.180084 Oct 11 12:16:14.343118 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 550/1146] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:16:14 2022] GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:16:15.365396 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-a586fc1e-5ec2-49a7-8f51-5b2ca5adbf56 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:16:15.366005 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-a586fc1e-5ec2-49a7-8f51-5b2ca5adbf56 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 38015aaa-72c1-420e-95bd-596e493b6e87] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:16:15.372511 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a586fc1e-5ec2-49a7-8f51-5b2ca5adbf56 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:15.373007 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a586fc1e-5ec2-49a7-8f51-5b2ca5adbf56 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:15.373434 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a586fc1e-5ec2-49a7-8f51-5b2ca5adbf56 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:15.374121 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a586fc1e-5ec2-49a7-8f51-5b2ca5adbf56 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:15.374578 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a586fc1e-5ec2-49a7-8f51-5b2ca5adbf56 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:15.375005 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-a586fc1e-5ec2-49a7-8f51-5b2ca5adbf56 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:15.505207 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-a586fc1e-5ec2-49a7-8f51-5b2ca5adbf56 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:16:15.513029 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-a586fc1e-5ec2-49a7-8f51-5b2ca5adbf56 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87" status: 200 len: 1265 microversion: 2.1 time: 0.151606 Oct 11 12:16:15.513599 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 597/1147] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:16:15 2022] GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:16:16.536271 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-4df45c7a-8179-4b04-aa6f-f163bd0baead tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:16:16.536903 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-4df45c7a-8179-4b04-aa6f-f163bd0baead tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 38015aaa-72c1-420e-95bd-596e493b6e87] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:16:16.543456 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4df45c7a-8179-4b04-aa6f-f163bd0baead tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:16.543936 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4df45c7a-8179-4b04-aa6f-f163bd0baead tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:16.544365 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4df45c7a-8179-4b04-aa6f-f163bd0baead tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:16.545045 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4df45c7a-8179-4b04-aa6f-f163bd0baead tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:16.545489 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4df45c7a-8179-4b04-aa6f-f163bd0baead tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:16.545903 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4df45c7a-8179-4b04-aa6f-f163bd0baead tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:16.677346 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-4df45c7a-8179-4b04-aa6f-f163bd0baead tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:16:16.685313 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-4df45c7a-8179-4b04-aa6f-f163bd0baead tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87" status: 200 len: 1265 microversion: 2.1 time: 0.152896 Oct 11 12:16:16.685865 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 551/1148] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:16:16 2022] GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:16:17.708301 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-793f7929-f551-41a6-9fff-da0ad9dd6cb7 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:16:17.708903 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-793f7929-f551-41a6-9fff-da0ad9dd6cb7 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 38015aaa-72c1-420e-95bd-596e493b6e87] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:16:17.711604 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=2 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:16:17.716731 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-793f7929-f551-41a6-9fff-da0ad9dd6cb7 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:17.717207 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-793f7929-f551-41a6-9fff-da0ad9dd6cb7 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:17.717631 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-793f7929-f551-41a6-9fff-da0ad9dd6cb7 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:17.718312 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-793f7929-f551-41a6-9fff-da0ad9dd6cb7 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:17.718776 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-793f7929-f551-41a6-9fff-da0ad9dd6cb7 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:17.719190 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-793f7929-f551-41a6-9fff-da0ad9dd6cb7 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:17.860032 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-793f7929-f551-41a6-9fff-da0ad9dd6cb7 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:16:17.862250 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:16:17.869019 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-793f7929-f551-41a6-9fff-da0ad9dd6cb7 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87" status: 200 len: 1265 microversion: 2.1 time: 0.165186 Oct 11 12:16:17.869603 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 598/1149] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:16:17 2022] GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:16:18.892037 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-0f23e677-1a8d-4e96-9e6e-8743fe5908a4 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:16:18.893218 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-0f23e677-1a8d-4e96-9e6e-8743fe5908a4 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 38015aaa-72c1-420e-95bd-596e493b6e87] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:16:18.896058 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell0:SELECT=2 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:16:18.897394 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell0:SELECT=6 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:16:18.898381 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:16:18.903470 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0f23e677-1a8d-4e96-9e6e-8743fe5908a4 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:18.904184 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0f23e677-1a8d-4e96-9e6e-8743fe5908a4 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:18.904779 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0f23e677-1a8d-4e96-9e6e-8743fe5908a4 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:18.905807 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0f23e677-1a8d-4e96-9e6e-8743fe5908a4 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:18.906521 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0f23e677-1a8d-4e96-9e6e-8743fe5908a4 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:18.907125 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-0f23e677-1a8d-4e96-9e6e-8743fe5908a4 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:18.913344 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:16:19.049390 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-0f23e677-1a8d-4e96-9e6e-8743fe5908a4 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:16:19.057173 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-0f23e677-1a8d-4e96-9e6e-8743fe5908a4 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87" status: 200 len: 1265 microversion: 2.1 time: 0.168938 Oct 11 12:16:19.058129 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 552/1150] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:16:18 2022] GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 12:16:20.084485 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-6aa345d6-0466-43aa-bd3f-5137640d8d4a tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:16:20.085476 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-6aa345d6-0466-43aa-bd3f-5137640d8d4a tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 38015aaa-72c1-420e-95bd-596e493b6e87] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:16:20.089700 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:16:20.095538 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6aa345d6-0466-43aa-bd3f-5137640d8d4a tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:20.096012 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6aa345d6-0466-43aa-bd3f-5137640d8d4a tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:20.096438 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6aa345d6-0466-43aa-bd3f-5137640d8d4a tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:20.097106 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6aa345d6-0466-43aa-bd3f-5137640d8d4a tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:20.097569 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6aa345d6-0466-43aa-bd3f-5137640d8d4a tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:20.097981 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-6aa345d6-0466-43aa-bd3f-5137640d8d4a tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:20.232665 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-6aa345d6-0466-43aa-bd3f-5137640d8d4a tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:16:20.240624 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-6aa345d6-0466-43aa-bd3f-5137640d8d4a tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87" status: 200 len: 1265 microversion: 2.1 time: 0.162669 Oct 11 12:16:20.241197 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 599/1151] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:16:20 2022] GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:16:20.256017 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-2f874fdc-2a65-4903-8cd8-e1a174e1bf98 req-1fef5dad-9135-41ec-bd99-272d2947f00f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38015aaa-72c1-420e-95bd-596e493b6e87", "name": "network-vif-plugged", "status": "completed", "tag": "98448cdf-7d5c-4dc2-9447-c9b25ebcaea1"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:16:20.269529 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-2f874fdc-2a65-4903-8cd8-e1a174e1bf98 req-1fef5dad-9135-41ec-bd99-272d2947f00f service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:20.270323 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-2f874fdc-2a65-4903-8cd8-e1a174e1bf98 req-1fef5dad-9135-41ec-bd99-272d2947f00f service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:20.270786 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-2f874fdc-2a65-4903-8cd8-e1a174e1bf98 req-1fef5dad-9135-41ec-bd99-272d2947f00f service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:20.290611 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-2f874fdc-2a65-4903-8cd8-e1a174e1bf98 req-1fef5dad-9135-41ec-bd99-272d2947f00f service nova] Creating event network-vif-plugged:98448cdf-7d5c-4dc2-9447-c9b25ebcaea1 for instance 38015aaa-72c1-420e-95bd-596e493b6e87 on hv-cinder-82099 Oct 11 12:16:20.296200 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-2f874fdc-2a65-4903-8cd8-e1a174e1bf98 req-1fef5dad-9135-41ec-bd99-272d2947f00f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044984 Oct 11 12:16:20.296902 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 553/1152] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:16:21.264238 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-76933773-0df7-4b1c-bcaa-2db4c4255593 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:16:21.264897 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-76933773-0df7-4b1c-bcaa-2db4c4255593 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 38015aaa-72c1-420e-95bd-596e493b6e87] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:16:21.271972 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-76933773-0df7-4b1c-bcaa-2db4c4255593 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:21.272446 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-76933773-0df7-4b1c-bcaa-2db4c4255593 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:21.272887 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-76933773-0df7-4b1c-bcaa-2db4c4255593 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:21.273556 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-76933773-0df7-4b1c-bcaa-2db4c4255593 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:21.274007 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-76933773-0df7-4b1c-bcaa-2db4c4255593 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:21.274423 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-76933773-0df7-4b1c-bcaa-2db4c4255593 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:21.405665 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-76933773-0df7-4b1c-bcaa-2db4c4255593 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:16:21.413811 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-76933773-0df7-4b1c-bcaa-2db4c4255593 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87" status: 200 len: 1265 microversion: 2.1 time: 0.153787 Oct 11 12:16:21.414479 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 600/1153] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:16:21 2022] GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:16:22.438380 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-ff0e0a4f-f887-45e0-b150-509c7ea0539b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:16:22.439328 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-ff0e0a4f-f887-45e0-b150-509c7ea0539b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 38015aaa-72c1-420e-95bd-596e493b6e87] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:16:22.446884 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ff0e0a4f-f887-45e0-b150-509c7ea0539b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:22.447362 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ff0e0a4f-f887-45e0-b150-509c7ea0539b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:22.447812 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ff0e0a4f-f887-45e0-b150-509c7ea0539b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:22.448497 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ff0e0a4f-f887-45e0-b150-509c7ea0539b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:22.448944 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ff0e0a4f-f887-45e0-b150-509c7ea0539b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:22.449358 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ff0e0a4f-f887-45e0-b150-509c7ea0539b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:22.601484 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-ff0e0a4f-f887-45e0-b150-509c7ea0539b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:16:22.609487 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-ff0e0a4f-f887-45e0-b150-509c7ea0539b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87" status: 200 len: 1451 microversion: 2.1 time: 0.175743 Oct 11 12:16:22.610620 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 554/1154] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:16:22 2022] GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87 => generated 1451 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:16:22.631880 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-fe79d2d2-5567-4bf5-b345-11f856e62bcb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:16:22.632483 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-fe79d2d2-5567-4bf5-b345-11f856e62bcb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 38015aaa-72c1-420e-95bd-596e493b6e87] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:16:22.639095 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fe79d2d2-5567-4bf5-b345-11f856e62bcb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:22.639652 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fe79d2d2-5567-4bf5-b345-11f856e62bcb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:22.640098 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fe79d2d2-5567-4bf5-b345-11f856e62bcb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:22.640892 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fe79d2d2-5567-4bf5-b345-11f856e62bcb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:22.641405 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fe79d2d2-5567-4bf5-b345-11f856e62bcb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:22.641903 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-fe79d2d2-5567-4bf5-b345-11f856e62bcb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:22.780257 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-fe79d2d2-5567-4bf5-b345-11f856e62bcb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:16:22.788171 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-fe79d2d2-5567-4bf5-b345-11f856e62bcb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87" status: 200 len: 1451 microversion: 2.1 time: 0.160098 Oct 11 12:16:22.788730 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 601/1155] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:16:22 2022] GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87 => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:16:24.759119 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-b861dc04-d91d-4d0e-bbdf-2b6e9b9ba5e4 req-b68a572c-068a-4c61-81cb-8716b8b2ad9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38015aaa-72c1-420e-95bd-596e493b6e87", "tag": "98448cdf-7d5c-4dc2-9447-c9b25ebcaea1"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:16:24.769107 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-b861dc04-d91d-4d0e-bbdf-2b6e9b9ba5e4 req-b68a572c-068a-4c61-81cb-8716b8b2ad9c service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:16:24.769578 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-b861dc04-d91d-4d0e-bbdf-2b6e9b9ba5e4 req-b68a572c-068a-4c61-81cb-8716b8b2ad9c service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:16:24.770282 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-b861dc04-d91d-4d0e-bbdf-2b6e9b9ba5e4 req-b68a572c-068a-4c61-81cb-8716b8b2ad9c service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:16:24.781640 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-b861dc04-d91d-4d0e-bbdf-2b6e9b9ba5e4 req-b68a572c-068a-4c61-81cb-8716b8b2ad9c service nova] Creating event network-changed:98448cdf-7d5c-4dc2-9447-c9b25ebcaea1 for instance 38015aaa-72c1-420e-95bd-596e493b6e87 on hv-cinder-82099 Oct 11 12:16:24.786694 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-b861dc04-d91d-4d0e-bbdf-2b6e9b9ba5e4 req-b68a572c-068a-4c61-81cb-8716b8b2ad9c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031339 Oct 11 12:16:24.787284 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 555/1156] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:18:23.950262 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a409b5a6-f719-4f0d-bdc7-626b19df2856] AMQP server on 10.222.0.59:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 12:18:23.954114 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-f9e09fc9-7d0b-40ba-b13e-b46cdc0bb91d tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1574506545", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-79745519", "security_groups": [{"name": "tempest-secgroup-smoke-1304625771"}], "block_device_mapping_v2": [{"uuid": "842db7a0-429f-4c9e-82a2-884ffa95b364", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "86bc98a2-e857-47e1-8cc0-6c28f4d3763e"}]}} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:18:23.964211 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=5 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:18:23.965139 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=19 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:18:23.965872 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 12:18:23.966045 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Tue Oct 11 12:18:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.59) !!! Oct 11 12:18:23.967567 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 12:18:23.967726 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Tue Oct 11 12:18:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.59) !!! Oct 11 12:18:24.077054 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.network.neutron [None req-f9e09fc9-7d0b-40ba-b13e-b46cdc0bb91d tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] validate_networks() for [('86bc98a2-e857-47e1-8cc0-6c28f4d3763e', None, None, None, None, None)] {{(pid=118995) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 12:18:24.553282 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-f9e09fc9-7d0b-40ba-b13e-b46cdc0bb91d tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Flavor limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 12:18:24.553845 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-f9e09fc9-7d0b-40ba-b13e-b46cdc0bb91d tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Image limits 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 12:18:24.554524 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-f9e09fc9-7d0b-40ba-b13e-b46cdc0bb91d tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Flavor pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 12:18:24.555168 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-f9e09fc9-7d0b-40ba-b13e-b46cdc0bb91d tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Image pref 0:0:0 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 12:18:24.555772 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.virt.hardware [None req-f9e09fc9-7d0b-40ba-b13e-b46cdc0bb91d tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118995) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 12:18:24.569744 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f9e09fc9-7d0b-40ba-b13e-b46cdc0bb91d tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:24.570443 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f9e09fc9-7d0b-40ba-b13e-b46cdc0bb91d tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:24.571080 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f9e09fc9-7d0b-40ba-b13e-b46cdc0bb91d tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:24.572207 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f9e09fc9-7d0b-40ba-b13e-b46cdc0bb91d tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:24.572848 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f9e09fc9-7d0b-40ba-b13e-b46cdc0bb91d tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:24.573444 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-f9e09fc9-7d0b-40ba-b13e-b46cdc0bb91d tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:24.590867 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-f9e09fc9-7d0b-40ba-b13e-b46cdc0bb91d tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Getting quotas for project 4f2eaa1959394ae3a4b4b27d00b917d1. Resources: {'ram', 'instances', 'cores'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 12:18:24.594862 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.quota [None req-f9e09fc9-7d0b-40ba-b13e-b46cdc0bb91d tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Getting quotas for user 82c54e3aa3aa46a28373acb91f32cc9a and project 4f2eaa1959394ae3a4b4b27d00b917d1. Resources: {'ram', 'instances', 'cores'} {{(pid=118995) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 12:18:24.660211 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f9e09fc9-7d0b-40ba-b13e-b46cdc0bb91d tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Going to run 1 instances... {{(pid=118995) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 12:18:24.662316 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-f9e09fc9-7d0b-40ba-b13e-b46cdc0bb91d tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: eb02d23d-0c73-4214-8f00-713a6c5922fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='842db7a0-429f-4c9e-82a2-884ffa95b364',volume_size=None,volume_type=None)] {{(pid=118995) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 12:18:24.799765 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-f9e09fc9-7d0b-40ba-b13e-b46cdc0bb91d tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.851213 Oct 11 12:18:24.800395 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 602/1157] 10.222.0.59 () {60 vars in 1147 bytes} [Tue Oct 11 12:18:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 852 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 12:18:24.810072 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR oslo.messaging._drivers.impl_rabbit [-] [189d8107-c02b-43fa-91fe-9d65f6ddac82] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 12:18:24.810732 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_api:SELECT=7 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:18:24.811443 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=15 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:18:24.813300 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 12:18:24.813437 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Tue Oct 11 12:18:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa (ip 10.222.0.59) !!! Oct 11 12:18:24.819279 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-00da6dbe-4d11-4af2-9e3a-5ce76465b25d tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:18:24.819977 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-00da6dbe-4d11-4af2-9e3a-5ce76465b25d tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: eb02d23d-0c73-4214-8f00-713a6c5922fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:18:24.876651 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-00da6dbe-4d11-4af2-9e3a-5ce76465b25d tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:18:24.884278 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-00da6dbe-4d11-4af2-9e3a-5ce76465b25d tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa" status: 200 len: 1093 microversion: 2.1 time: 0.076263 Oct 11 12:18:24.884835 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 556/1158] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:18:24 2022] GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa => generated 1093 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:18:25.909691 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-aa57bb17-7b26-4b62-b234-ffa6c017fa8c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:18:25.910289 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-aa57bb17-7b26-4b62-b234-ffa6c017fa8c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: eb02d23d-0c73-4214-8f00-713a6c5922fa] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:18:25.918624 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aa57bb17-7b26-4b62-b234-ffa6c017fa8c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:25.919148 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aa57bb17-7b26-4b62-b234-ffa6c017fa8c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:25.919706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aa57bb17-7b26-4b62-b234-ffa6c017fa8c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:25.920517 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aa57bb17-7b26-4b62-b234-ffa6c017fa8c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:25.920959 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aa57bb17-7b26-4b62-b234-ffa6c017fa8c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:25.921467 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-aa57bb17-7b26-4b62-b234-ffa6c017fa8c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:25.926584 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO oslo.messaging._drivers.impl_rabbit [-] [a409b5a6-f719-4f0d-bdc7-626b19df2856] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 33646. Oct 11 12:18:25.987967 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-aa57bb17-7b26-4b62-b234-ffa6c017fa8c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:18:25.995827 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-aa57bb17-7b26-4b62-b234-ffa6c017fa8c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa" status: 200 len: 1191 microversion: 2.1 time: 0.091882 Oct 11 12:18:25.996385 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 603/1159] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:18:25 2022] GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa => generated 1191 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:18:27.019545 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-a52cbd40-8eac-4124-8461-1e3007c795dc tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:18:27.020328 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-a52cbd40-8eac-4124-8461-1e3007c795dc tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: eb02d23d-0c73-4214-8f00-713a6c5922fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:18:27.030756 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a52cbd40-8eac-4124-8461-1e3007c795dc tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:27.031690 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a52cbd40-8eac-4124-8461-1e3007c795dc tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:27.032086 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a52cbd40-8eac-4124-8461-1e3007c795dc tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:27.032974 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a52cbd40-8eac-4124-8461-1e3007c795dc tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:27.033438 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a52cbd40-8eac-4124-8461-1e3007c795dc tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:27.033836 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-a52cbd40-8eac-4124-8461-1e3007c795dc tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:27.039936 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO oslo.messaging._drivers.impl_rabbit [-] [189d8107-c02b-43fa-91fe-9d65f6ddac82] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 33650. Oct 11 12:18:27.188933 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-a52cbd40-8eac-4124-8461-1e3007c795dc tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:18:27.197245 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-a52cbd40-8eac-4124-8461-1e3007c795dc tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa" status: 200 len: 1277 microversion: 2.1 time: 0.182449 Oct 11 12:18:27.197947 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 557/1160] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:18:27 2022] GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa => generated 1277 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:18:27.748348 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-613c9c85-ec8f-4a10-93c6-455bf995ea3b req-10b9a818-65b2-45ce-be7b-ad574a9d8e82 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb02d23d-0c73-4214-8f00-713a6c5922fa", "tag": "6a3339c9-dedf-471b-a7be-922c35763ffb"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:18:27.762680 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-613c9c85-ec8f-4a10-93c6-455bf995ea3b req-10b9a818-65b2-45ce-be7b-ad574a9d8e82 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:27.763158 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-613c9c85-ec8f-4a10-93c6-455bf995ea3b req-10b9a818-65b2-45ce-be7b-ad574a9d8e82 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:27.763582 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-613c9c85-ec8f-4a10-93c6-455bf995ea3b req-10b9a818-65b2-45ce-be7b-ad574a9d8e82 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:27.774908 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-613c9c85-ec8f-4a10-93c6-455bf995ea3b req-10b9a818-65b2-45ce-be7b-ad574a9d8e82 service nova] Creating event network-changed:6a3339c9-dedf-471b-a7be-922c35763ffb for instance eb02d23d-0c73-4214-8f00-713a6c5922fa on hv-cinder-82099 Oct 11 12:18:27.781514 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-613c9c85-ec8f-4a10-93c6-455bf995ea3b req-10b9a818-65b2-45ce-be7b-ad574a9d8e82 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041487 Oct 11 12:18:27.782270 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 604/1161] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:18:28.220713 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-16aabba7-f450-47b5-8352-60aee350e319 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:18:28.221318 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-16aabba7-f450-47b5-8352-60aee350e319 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: eb02d23d-0c73-4214-8f00-713a6c5922fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:18:28.227769 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-16aabba7-f450-47b5-8352-60aee350e319 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:28.228247 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-16aabba7-f450-47b5-8352-60aee350e319 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:28.228668 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-16aabba7-f450-47b5-8352-60aee350e319 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:28.229343 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-16aabba7-f450-47b5-8352-60aee350e319 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:28.229786 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-16aabba7-f450-47b5-8352-60aee350e319 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:28.230227 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-16aabba7-f450-47b5-8352-60aee350e319 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:28.362537 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-16aabba7-f450-47b5-8352-60aee350e319 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:18:28.371048 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-16aabba7-f450-47b5-8352-60aee350e319 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa" status: 200 len: 1265 microversion: 2.1 time: 0.154470 Oct 11 12:18:28.371616 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 558/1162] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:18:28 2022] GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:18:29.394082 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-39e15443-95f4-4735-a6fa-c5a2ea5acf23 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:18:29.395152 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-39e15443-95f4-4735-a6fa-c5a2ea5acf23 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: eb02d23d-0c73-4214-8f00-713a6c5922fa] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:18:29.401779 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-39e15443-95f4-4735-a6fa-c5a2ea5acf23 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:29.402246 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-39e15443-95f4-4735-a6fa-c5a2ea5acf23 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:29.402693 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-39e15443-95f4-4735-a6fa-c5a2ea5acf23 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:29.403438 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-39e15443-95f4-4735-a6fa-c5a2ea5acf23 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:29.403913 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-39e15443-95f4-4735-a6fa-c5a2ea5acf23 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:29.404327 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-39e15443-95f4-4735-a6fa-c5a2ea5acf23 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:29.582102 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-39e15443-95f4-4735-a6fa-c5a2ea5acf23 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:18:29.590087 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-39e15443-95f4-4735-a6fa-c5a2ea5acf23 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa" status: 200 len: 1265 microversion: 2.1 time: 0.200194 Oct 11 12:18:29.590690 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 605/1163] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:18:29 2022] GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:18:30.617218 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-835092e4-69b6-49b3-8fe1-9eb07639b948 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:18:30.618153 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-835092e4-69b6-49b3-8fe1-9eb07639b948 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: eb02d23d-0c73-4214-8f00-713a6c5922fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:18:30.629071 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-835092e4-69b6-49b3-8fe1-9eb07639b948 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:30.629851 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-835092e4-69b6-49b3-8fe1-9eb07639b948 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:30.630621 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-835092e4-69b6-49b3-8fe1-9eb07639b948 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:30.631727 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-835092e4-69b6-49b3-8fe1-9eb07639b948 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:30.632462 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-835092e4-69b6-49b3-8fe1-9eb07639b948 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:30.633182 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-835092e4-69b6-49b3-8fe1-9eb07639b948 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:30.767071 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-835092e4-69b6-49b3-8fe1-9eb07639b948 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:18:30.775313 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-835092e4-69b6-49b3-8fe1-9eb07639b948 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa" status: 200 len: 1265 microversion: 2.1 time: 0.164593 Oct 11 12:18:30.775883 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 559/1164] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:18:30 2022] GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:18:31.801977 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-62395c26-0b55-4ac6-a44e-c58b5f19dcda tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:18:31.802979 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-62395c26-0b55-4ac6-a44e-c58b5f19dcda tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: eb02d23d-0c73-4214-8f00-713a6c5922fa] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:18:31.812270 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-62395c26-0b55-4ac6-a44e-c58b5f19dcda tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:31.812743 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-62395c26-0b55-4ac6-a44e-c58b5f19dcda tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:31.813167 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-62395c26-0b55-4ac6-a44e-c58b5f19dcda tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:31.813847 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-62395c26-0b55-4ac6-a44e-c58b5f19dcda tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:31.814285 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-62395c26-0b55-4ac6-a44e-c58b5f19dcda tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:31.814738 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-62395c26-0b55-4ac6-a44e-c58b5f19dcda tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:31.949671 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-62395c26-0b55-4ac6-a44e-c58b5f19dcda tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:18:31.957867 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-62395c26-0b55-4ac6-a44e-c58b5f19dcda tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa" status: 200 len: 1265 microversion: 2.1 time: 0.162324 Oct 11 12:18:31.958443 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 606/1165] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:18:31 2022] GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:18:32.984103 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-1f183d05-2435-453f-924c-955d099bd38c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:18:32.984719 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-1f183d05-2435-453f-924c-955d099bd38c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: eb02d23d-0c73-4214-8f00-713a6c5922fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:18:32.994623 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1f183d05-2435-453f-924c-955d099bd38c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:32.995289 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1f183d05-2435-453f-924c-955d099bd38c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:32.995879 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1f183d05-2435-453f-924c-955d099bd38c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:32.996889 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1f183d05-2435-453f-924c-955d099bd38c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:32.997442 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1f183d05-2435-453f-924c-955d099bd38c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:32.997875 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1f183d05-2435-453f-924c-955d099bd38c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:33.126580 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-1f183d05-2435-453f-924c-955d099bd38c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:18:33.134366 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-1f183d05-2435-453f-924c-955d099bd38c tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa" status: 200 len: 1265 microversion: 2.1 time: 0.156532 Oct 11 12:18:33.134969 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 560/1166] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:18:32 2022] GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:18:34.161462 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-44529e0e-9549-4a46-96c5-654b6a41a6bb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:18:34.162429 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-44529e0e-9549-4a46-96c5-654b6a41a6bb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: eb02d23d-0c73-4214-8f00-713a6c5922fa] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:18:34.172167 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-44529e0e-9549-4a46-96c5-654b6a41a6bb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:34.172646 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-44529e0e-9549-4a46-96c5-654b6a41a6bb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:34.173077 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-44529e0e-9549-4a46-96c5-654b6a41a6bb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:34.173760 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-44529e0e-9549-4a46-96c5-654b6a41a6bb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:34.174206 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-44529e0e-9549-4a46-96c5-654b6a41a6bb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:34.174646 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-44529e0e-9549-4a46-96c5-654b6a41a6bb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:34.321900 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-44529e0e-9549-4a46-96c5-654b6a41a6bb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:18:34.330184 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-44529e0e-9549-4a46-96c5-654b6a41a6bb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa" status: 200 len: 1265 microversion: 2.1 time: 0.175361 Oct 11 12:18:34.330794 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 607/1167] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:18:34 2022] GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:18:35.354236 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-ae7f1ebe-59e2-4f15-b6c4-8fce33069941 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:18:35.354869 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-ae7f1ebe-59e2-4f15-b6c4-8fce33069941 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: eb02d23d-0c73-4214-8f00-713a6c5922fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:18:35.357303 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell0:SELECT=2 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:18:35.362780 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ae7f1ebe-59e2-4f15-b6c4-8fce33069941 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:35.363256 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ae7f1ebe-59e2-4f15-b6c4-8fce33069941 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:35.363689 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ae7f1ebe-59e2-4f15-b6c4-8fce33069941 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:35.364374 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ae7f1ebe-59e2-4f15-b6c4-8fce33069941 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:35.364828 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ae7f1ebe-59e2-4f15-b6c4-8fce33069941 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:35.365229 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-ae7f1ebe-59e2-4f15-b6c4-8fce33069941 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:35.503588 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-ae7f1ebe-59e2-4f15-b6c4-8fce33069941 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:18:35.515463 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-ae7f1ebe-59e2-4f15-b6c4-8fce33069941 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa" status: 200 len: 1265 microversion: 2.1 time: 0.164685 Oct 11 12:18:35.515862 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 561/1168] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:18:35 2022] GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:18:36.542490 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-45832663-1796-4626-9807-9ce5dda50f29 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:18:36.543492 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-45832663-1796-4626-9807-9ce5dda50f29 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: eb02d23d-0c73-4214-8f00-713a6c5922fa] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:18:36.545990 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=2 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:18:36.546689 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell0:SELECT=6 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:18:36.553161 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-45832663-1796-4626-9807-9ce5dda50f29 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:36.553641 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-45832663-1796-4626-9807-9ce5dda50f29 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:36.554077 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-45832663-1796-4626-9807-9ce5dda50f29 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:36.554794 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-45832663-1796-4626-9807-9ce5dda50f29 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:36.555240 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-45832663-1796-4626-9807-9ce5dda50f29 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:36.555661 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-45832663-1796-4626-9807-9ce5dda50f29 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:36.692108 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-45832663-1796-4626-9807-9ce5dda50f29 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:18:36.700269 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-45832663-1796-4626-9807-9ce5dda50f29 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa" status: 200 len: 1265 microversion: 2.1 time: 0.164132 Oct 11 12:18:36.701022 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 608/1169] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:18:36 2022] GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:18:37.727128 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-cfc61734-a8ac-45d6-8f4c-fb5a25cebe86 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:18:37.728439 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-cfc61734-a8ac-45d6-8f4c-fb5a25cebe86 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: eb02d23d-0c73-4214-8f00-713a6c5922fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:18:37.739195 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cfc61734-a8ac-45d6-8f4c-fb5a25cebe86 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:37.739991 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cfc61734-a8ac-45d6-8f4c-fb5a25cebe86 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:37.740701 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cfc61734-a8ac-45d6-8f4c-fb5a25cebe86 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:37.741840 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cfc61734-a8ac-45d6-8f4c-fb5a25cebe86 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:37.742592 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cfc61734-a8ac-45d6-8f4c-fb5a25cebe86 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:37.743360 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-cfc61734-a8ac-45d6-8f4c-fb5a25cebe86 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:37.875342 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-cfc61734-a8ac-45d6-8f4c-fb5a25cebe86 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:18:37.886992 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-cfc61734-a8ac-45d6-8f4c-fb5a25cebe86 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa" status: 200 len: 1265 microversion: 2.1 time: 0.166476 Oct 11 12:18:37.887707 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 562/1170] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:18:37 2022] GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:18:38.910875 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-ae9fd945-5c7a-4620-9bd1-79189e9e9933 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:18:38.912519 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-ae9fd945-5c7a-4620-9bd1-79189e9e9933 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: eb02d23d-0c73-4214-8f00-713a6c5922fa] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:18:38.919418 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ae9fd945-5c7a-4620-9bd1-79189e9e9933 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:38.920033 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ae9fd945-5c7a-4620-9bd1-79189e9e9933 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:38.920462 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ae9fd945-5c7a-4620-9bd1-79189e9e9933 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:38.921149 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ae9fd945-5c7a-4620-9bd1-79189e9e9933 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:38.921589 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ae9fd945-5c7a-4620-9bd1-79189e9e9933 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:38.922004 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-ae9fd945-5c7a-4620-9bd1-79189e9e9933 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:39.069944 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-ae9fd945-5c7a-4620-9bd1-79189e9e9933 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:18:39.078319 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-ae9fd945-5c7a-4620-9bd1-79189e9e9933 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa" status: 200 len: 1265 microversion: 2.1 time: 0.171524 Oct 11 12:18:39.079100 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 609/1171] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:18:38 2022] GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:18:39.126063 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-39c1a978-3f4a-4d18-ac2e-d12bcef4a2b0 req-6c352ffe-3d2c-417a-a851-ff1689c22f3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb02d23d-0c73-4214-8f00-713a6c5922fa", "name": "network-vif-plugged", "status": "completed", "tag": "6a3339c9-dedf-471b-a7be-922c35763ffb"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:18:39.135417 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-39c1a978-3f4a-4d18-ac2e-d12bcef4a2b0 req-6c352ffe-3d2c-417a-a851-ff1689c22f3f service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:39.135879 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-39c1a978-3f4a-4d18-ac2e-d12bcef4a2b0 req-6c352ffe-3d2c-417a-a851-ff1689c22f3f service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:39.136295 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-39c1a978-3f4a-4d18-ac2e-d12bcef4a2b0 req-6c352ffe-3d2c-417a-a851-ff1689c22f3f service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:39.151685 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-39c1a978-3f4a-4d18-ac2e-d12bcef4a2b0 req-6c352ffe-3d2c-417a-a851-ff1689c22f3f service nova] Creating event network-vif-plugged:6a3339c9-dedf-471b-a7be-922c35763ffb for instance eb02d23d-0c73-4214-8f00-713a6c5922fa on hv-cinder-82099 Oct 11 12:18:39.155954 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR oslo.messaging._drivers.impl_rabbit [req-39c1a978-3f4a-4d18-ac2e-d12bcef4a2b0 req-6c352ffe-3d2c-417a-a851-ff1689c22f3f service nova] [0cd3588a-5742-4899-8d3b-dae90590be48] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 12:18:40.105452 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-11982cdb-87a5-46f2-9a60-785a7a842b3b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:18:40.106642 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-11982cdb-87a5-46f2-9a60-785a7a842b3b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: eb02d23d-0c73-4214-8f00-713a6c5922fa] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:18:40.114720 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-11982cdb-87a5-46f2-9a60-785a7a842b3b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:40.115304 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-11982cdb-87a5-46f2-9a60-785a7a842b3b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:40.115805 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-11982cdb-87a5-46f2-9a60-785a7a842b3b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:40.116603 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-11982cdb-87a5-46f2-9a60-785a7a842b3b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:40.117120 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-11982cdb-87a5-46f2-9a60-785a7a842b3b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:40.117605 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-11982cdb-87a5-46f2-9a60-785a7a842b3b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:40.163745 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO oslo.messaging._drivers.impl_rabbit [req-39c1a978-3f4a-4d18-ac2e-d12bcef4a2b0 req-6c352ffe-3d2c-417a-a851-ff1689c22f3f service nova] [0cd3588a-5742-4899-8d3b-dae90590be48] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 33688. Oct 11 12:18:40.167590 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-39c1a978-3f4a-4d18-ac2e-d12bcef4a2b0 req-6c352ffe-3d2c-417a-a851-ff1689c22f3f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.194378 Oct 11 12:18:40.168185 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 563/1172] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:18:40.262627 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-11982cdb-87a5-46f2-9a60-785a7a842b3b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:18:40.271051 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-11982cdb-87a5-46f2-9a60-785a7a842b3b tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa" status: 200 len: 1265 microversion: 2.1 time: 0.171911 Oct 11 12:18:40.271614 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 610/1173] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:18:40 2022] GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:18:41.295380 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-9c1226f6-d0aa-4b9a-918e-46a6169cd0cb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:18:41.296054 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-9c1226f6-d0aa-4b9a-918e-46a6169cd0cb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: eb02d23d-0c73-4214-8f00-713a6c5922fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:18:41.302860 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9c1226f6-d0aa-4b9a-918e-46a6169cd0cb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:41.303358 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9c1226f6-d0aa-4b9a-918e-46a6169cd0cb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:41.303783 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9c1226f6-d0aa-4b9a-918e-46a6169cd0cb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:41.304465 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9c1226f6-d0aa-4b9a-918e-46a6169cd0cb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:41.304906 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9c1226f6-d0aa-4b9a-918e-46a6169cd0cb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:41.305324 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-9c1226f6-d0aa-4b9a-918e-46a6169cd0cb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:41.440546 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-9c1226f6-d0aa-4b9a-918e-46a6169cd0cb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:18:41.448646 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-9c1226f6-d0aa-4b9a-918e-46a6169cd0cb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa" status: 200 len: 1265 microversion: 2.1 time: 0.158208 Oct 11 12:18:41.449211 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 564/1174] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:18:41 2022] GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:18:42.475395 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8de2f04a-7b56-49cc-8b4e-9ea9a7bec4da tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:18:42.476319 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8de2f04a-7b56-49cc-8b4e-9ea9a7bec4da tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: eb02d23d-0c73-4214-8f00-713a6c5922fa] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:18:42.485199 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8de2f04a-7b56-49cc-8b4e-9ea9a7bec4da tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:42.485670 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8de2f04a-7b56-49cc-8b4e-9ea9a7bec4da tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:42.486095 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8de2f04a-7b56-49cc-8b4e-9ea9a7bec4da tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:42.486812 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8de2f04a-7b56-49cc-8b4e-9ea9a7bec4da tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:42.487256 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8de2f04a-7b56-49cc-8b4e-9ea9a7bec4da tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:42.487668 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8de2f04a-7b56-49cc-8b4e-9ea9a7bec4da tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:42.631671 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8de2f04a-7b56-49cc-8b4e-9ea9a7bec4da tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:18:42.639777 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8de2f04a-7b56-49cc-8b4e-9ea9a7bec4da tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa" status: 200 len: 1452 microversion: 2.1 time: 0.170848 Oct 11 12:18:42.640344 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 611/1175] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:18:42 2022] GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa => generated 1452 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:18:42.662257 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-c174b97e-e9b8-4333-aaa8-5983cf7204c6 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:18:42.662937 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-c174b97e-e9b8-4333-aaa8-5983cf7204c6 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: eb02d23d-0c73-4214-8f00-713a6c5922fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:18:42.669733 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c174b97e-e9b8-4333-aaa8-5983cf7204c6 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:42.670202 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c174b97e-e9b8-4333-aaa8-5983cf7204c6 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:42.670664 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c174b97e-e9b8-4333-aaa8-5983cf7204c6 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:42.671347 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c174b97e-e9b8-4333-aaa8-5983cf7204c6 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:42.671793 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c174b97e-e9b8-4333-aaa8-5983cf7204c6 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:42.672208 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-c174b97e-e9b8-4333-aaa8-5983cf7204c6 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:42.824264 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-c174b97e-e9b8-4333-aaa8-5983cf7204c6 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:18:42.832312 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-c174b97e-e9b8-4333-aaa8-5983cf7204c6 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa" status: 200 len: 1452 microversion: 2.1 time: 0.173901 Oct 11 12:18:42.832878 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 565/1176] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:18:42 2022] GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa => generated 1452 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:18:44.830717 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-72998c21-f629-4119-946b-06b76816ebb7 req-b55223b4-eded-49bc-a1d0-382bb83b64a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb02d23d-0c73-4214-8f00-713a6c5922fa", "tag": "6a3339c9-dedf-471b-a7be-922c35763ffb"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:18:44.840852 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-72998c21-f629-4119-946b-06b76816ebb7 req-b55223b4-eded-49bc-a1d0-382bb83b64a6 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:18:44.841409 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-72998c21-f629-4119-946b-06b76816ebb7 req-b55223b4-eded-49bc-a1d0-382bb83b64a6 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:18:44.841924 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-72998c21-f629-4119-946b-06b76816ebb7 req-b55223b4-eded-49bc-a1d0-382bb83b64a6 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:18:44.852758 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-72998c21-f629-4119-946b-06b76816ebb7 req-b55223b4-eded-49bc-a1d0-382bb83b64a6 service nova] Creating event network-changed:6a3339c9-dedf-471b-a7be-922c35763ffb for instance eb02d23d-0c73-4214-8f00-713a6c5922fa on hv-cinder-82099 Oct 11 12:18:44.857880 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-72998c21-f629-4119-946b-06b76816ebb7 req-b55223b4-eded-49bc-a1d0-382bb83b64a6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030897 Oct 11 12:18:44.858453 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 612/1177] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:20:35.655714 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_api:SELECT=22 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:20:35.656446 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG dbcounter [-] [118994] Writing DB stats nova_cell1:SELECT=50 {{(pid=118994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:20:35.657980 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a409b5a6-f719-4f0d-bdc7-626b19df2856] AMQP server on 10.222.0.59:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 11 12:20:35.658594 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:20:35.659577 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG dbcounter [-] [118995] Writing DB stats nova_cell1:SELECT=54 {{(pid=118995) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 12:20:35.659741 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 12:20:35.659872 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Tue Oct 11 12:20:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa (ip 10.222.0.59) !!! Oct 11 12:20:35.664883 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-f1be624b-2f7d-4469-9463-4f9ef2846bde req-ff9484ec-8947-436d-8660-3f4997a0459c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eb02d23d-0c73-4214-8f00-713a6c5922fa", "tag": "6a3339c9-dedf-471b-a7be-922c35763ffb"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:20:35.672613 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-1970600a-dbc5-4e16-850e-75bf0c7c400e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:20:35.673148 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-1970600a-dbc5-4e16-850e-75bf0c7c400e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: eb02d23d-0c73-4214-8f00-713a6c5922fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:20:35.676713 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-f1be624b-2f7d-4469-9463-4f9ef2846bde req-ff9484ec-8947-436d-8660-3f4997a0459c service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:20:35.677250 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-f1be624b-2f7d-4469-9463-4f9ef2846bde req-ff9484ec-8947-436d-8660-3f4997a0459c service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:20:35.677776 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-f1be624b-2f7d-4469-9463-4f9ef2846bde req-ff9484ec-8947-436d-8660-3f4997a0459c service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:20:35.680008 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1970600a-dbc5-4e16-850e-75bf0c7c400e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:20:35.680518 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1970600a-dbc5-4e16-850e-75bf0c7c400e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:20:35.680918 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1970600a-dbc5-4e16-850e-75bf0c7c400e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:20:35.682064 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1970600a-dbc5-4e16-850e-75bf0c7c400e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:20:35.682064 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1970600a-dbc5-4e16-850e-75bf0c7c400e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:20:35.682458 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-1970600a-dbc5-4e16-850e-75bf0c7c400e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:20:35.689310 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-f1be624b-2f7d-4469-9463-4f9ef2846bde req-ff9484ec-8947-436d-8660-3f4997a0459c service nova] Creating event network-changed:6a3339c9-dedf-471b-a7be-922c35763ffb for instance eb02d23d-0c73-4214-8f00-713a6c5922fa on hv-cinder-82099 Oct 11 12:20:35.694401 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-f1be624b-2f7d-4469-9463-4f9ef2846bde req-ff9484ec-8947-436d-8660-3f4997a0459c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038271 Oct 11 12:20:35.695119 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 613/1178] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:20:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 12:20:35.709708 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-1970600a-dbc5-4e16-850e-75bf0c7c400e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: eb02d23d-0c73-4214-8f00-713a6c5922fa] Going to try to terminate instance {{(pid=118994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 12:20:35.803866 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-1970600a-dbc5-4e16-850e-75bf0c7c400e tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "DELETE /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa" status: 204 len: 0 microversion: 2.1 time: 0.150080 Oct 11 12:20:35.804689 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 566/1179] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Oct 11 12:20:35 2022] DELETE /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 12:20:35.813786 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-9104197f-9e0e-4bd9-9a5f-cf32e90d0a51 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:20:35.814480 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-9104197f-9e0e-4bd9-9a5f-cf32e90d0a51 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: eb02d23d-0c73-4214-8f00-713a6c5922fa] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:20:35.822703 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9104197f-9e0e-4bd9-9a5f-cf32e90d0a51 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:20:35.823241 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9104197f-9e0e-4bd9-9a5f-cf32e90d0a51 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:20:35.823680 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9104197f-9e0e-4bd9-9a5f-cf32e90d0a51 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:20:35.824523 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9104197f-9e0e-4bd9-9a5f-cf32e90d0a51 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:20:35.825164 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9104197f-9e0e-4bd9-9a5f-cf32e90d0a51 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:20:35.825706 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-9104197f-9e0e-4bd9-9a5f-cf32e90d0a51 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:20:36.026302 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-9104197f-9e0e-4bd9-9a5f-cf32e90d0a51 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:20:36.034356 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-9104197f-9e0e-4bd9-9a5f-cf32e90d0a51 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa" status: 200 len: 1577 microversion: 2.1 time: 0.224844 Oct 11 12:20:36.035121 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 614/1180] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:20:35 2022] GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa => generated 1577 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:20:37.058032 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-4e6ca050-923d-4b0c-a118-ab30c42952ad tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:20:37.058801 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-4e6ca050-923d-4b0c-a118-ab30c42952ad tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: eb02d23d-0c73-4214-8f00-713a6c5922fa] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:20:37.065634 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4e6ca050-923d-4b0c-a118-ab30c42952ad tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:20:37.066116 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4e6ca050-923d-4b0c-a118-ab30c42952ad tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:20:37.066543 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4e6ca050-923d-4b0c-a118-ab30c42952ad tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:20:37.067275 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4e6ca050-923d-4b0c-a118-ab30c42952ad tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:20:37.067718 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4e6ca050-923d-4b0c-a118-ab30c42952ad tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:20:37.068142 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-4e6ca050-923d-4b0c-a118-ab30c42952ad tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:20:37.290322 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-4e6ca050-923d-4b0c-a118-ab30c42952ad tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:20:37.298539 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-4e6ca050-923d-4b0c-a118-ab30c42952ad tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa" status: 200 len: 1577 microversion: 2.1 time: 0.244774 Oct 11 12:20:37.299150 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 567/1181] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:20:37 2022] GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa => generated 1577 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:20:38.321510 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8b44831b-ad3f-43ee-9f71-b1231a541bf0 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:20:38.322159 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8b44831b-ad3f-43ee-9f71-b1231a541bf0 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: eb02d23d-0c73-4214-8f00-713a6c5922fa] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:20:38.330696 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8b44831b-ad3f-43ee-9f71-b1231a541bf0 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:20:38.331240 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8b44831b-ad3f-43ee-9f71-b1231a541bf0 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:20:38.331663 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8b44831b-ad3f-43ee-9f71-b1231a541bf0 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:20:38.332411 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8b44831b-ad3f-43ee-9f71-b1231a541bf0 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:20:38.332831 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8b44831b-ad3f-43ee-9f71-b1231a541bf0 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:20:38.333266 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8b44831b-ad3f-43ee-9f71-b1231a541bf0 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:20:38.339675 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO oslo.messaging._drivers.impl_rabbit [-] [a409b5a6-f719-4f0d-bdc7-626b19df2856] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 33754. Oct 11 12:20:38.557025 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [req-b99b64ba-1fa1-47ae-9940-ffbbdd3d3d27 req-8e581e62-de72-4149-bc3c-d953bd885e1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eb02d23d-0c73-4214-8f00-713a6c5922fa", "name": "network-vif-deleted", "tag": "6a3339c9-dedf-471b-a7be-922c35763ffb"}]} {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:20:38.562835 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-8b44831b-ad3f-43ee-9f71-b1231a541bf0 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:20:38.568800 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-b99b64ba-1fa1-47ae-9940-ffbbdd3d3d27 req-8e581e62-de72-4149-bc3c-d953bd885e1f service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:20:38.569363 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-b99b64ba-1fa1-47ae-9940-ffbbdd3d3d27 req-8e581e62-de72-4149-bc3c-d953bd885e1f service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:20:38.570020 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [req-b99b64ba-1fa1-47ae-9940-ffbbdd3d3d27 req-8e581e62-de72-4149-bc3c-d953bd885e1f service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:20:38.571457 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8b44831b-ad3f-43ee-9f71-b1231a541bf0 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa" status: 200 len: 1458 microversion: 2.1 time: 0.253888 Oct 11 12:20:38.572036 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 615/1182] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:20:38 2022] GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa => generated 1458 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:20:38.584354 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.compute.server_external_events [req-b99b64ba-1fa1-47ae-9940-ffbbdd3d3d27 req-8e581e62-de72-4149-bc3c-d953bd885e1f service nova] Creating event network-vif-deleted:6a3339c9-dedf-471b-a7be-922c35763ffb for instance eb02d23d-0c73-4214-8f00-713a6c5922fa on hv-cinder-82099 Oct 11 12:20:38.589754 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [req-b99b64ba-1fa1-47ae-9940-ffbbdd3d3d27 req-8e581e62-de72-4149-bc3c-d953bd885e1f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036626 Oct 11 12:20:38.590349 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 568/1183] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:20:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:20:39.596882 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-eef0dc16-5c79-4a79-b2c1-b7c94e4075c7 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:20:39.597531 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-eef0dc16-5c79-4a79-b2c1-b7c94e4075c7 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: eb02d23d-0c73-4214-8f00-713a6c5922fa] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:20:39.604261 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eef0dc16-5c79-4a79-b2c1-b7c94e4075c7 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:20:39.604736 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eef0dc16-5c79-4a79-b2c1-b7c94e4075c7 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:20:39.605160 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eef0dc16-5c79-4a79-b2c1-b7c94e4075c7 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:20:39.605842 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eef0dc16-5c79-4a79-b2c1-b7c94e4075c7 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:20:39.606285 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eef0dc16-5c79-4a79-b2c1-b7c94e4075c7 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:20:39.606851 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-eef0dc16-5c79-4a79-b2c1-b7c94e4075c7 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:20:39.620250 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-eef0dc16-5c79-4a79-b2c1-b7c94e4075c7 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] HTTP exception thrown: Instance eb02d23d-0c73-4214-8f00-713a6c5922fa could not be found. Oct 11 12:20:39.621879 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-eef0dc16-5c79-4a79-b2c1-b7c94e4075c7 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Request method failure captured: Oct 11 12:20:39.621879 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa HTTP/1.1 Oct 11 12:20:39.621879 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 11 12:20:39.621879 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 11 12:20:39.621879 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Connection: close Oct 11 12:20:39.621879 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 11 12:20:39.621879 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 11 12:20:39.621879 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Host: 10.222.0.59 Oct 11 12:20:39.621879 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 11 12:20:39.621879 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 11 12:20:39.621879 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjRV3B3Ze2uMjiHad5GYeO-UuPwIbvGl7_ItGEygJinfPbqd63zqUFbzq4h6lT2072e_nEWiV9vy1oWj6HwkQ25mu5eDMXbJl4e6yTq2w79o-ctUFK8rr9ARidvk5gzBS09zXWOdfB8T4j29naGWXC0wC_gE7F01RblioUVP8TW3NFGm8 Oct 11 12:20:39.621879 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 11 12:20:39.621879 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 11 12:20:39.621879 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 11 12:20:39.621879 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 11 12:20:39.621879 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 11 12:20:39.621879 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 11 12:20:39.621879 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Id: 4f2eaa1959394ae3a4b4b27d00b917d1 Oct 11 12:20:39.621879 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-TestVolumeBootPattern-945275872 Oct 11 12:20:39.621879 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Role: reader,member Oct 11 12:20:39.621879 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Roles: reader,member Oct 11 12:20:39.623693 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4f2eaa1959394ae3a4b4b27d00b917d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4f2eaa1959394ae3a4b4b27d00b917d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f2eaa1959394ae3a4b4b27d00b917d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f2eaa1959394ae3a4b4b27d00b917d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:20:39.623693 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-TestVolumeBootPattern-945275872 Oct 11 12:20:39.623693 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 4f2eaa1959394ae3a4b4b27d00b917d1 Oct 11 12:20:39.623693 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-TestVolumeBootPattern-945275872 Oct 11 12:20:39.623693 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User: tempest-TestVolumeBootPattern-945275872-project Oct 11 12:20:39.623693 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 11 12:20:39.623693 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 11 12:20:39.623693 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Id: 82c54e3aa3aa46a28373acb91f32cc9a Oct 11 12:20:39.623693 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-TestVolumeBootPattern-945275872-project Oct 11 12:20:39.623693 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: method: > Oct 11 12:20:39.623693 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: exception: Instance eb02d23d-0c73-4214-8f00-713a6c5922fa could not be found. Oct 11 12:20:39.623693 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: action_args: {'id': 'eb02d23d-0c73-4214-8f00-713a6c5922fa'} Oct 11 12:20:39.624663 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:20:39.624663 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:20:39.624663 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:20:39.624663 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:20:39.624663 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:20:39.624663 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:20:39.624663 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:20:39.624663 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:20:39.624663 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:20:39.624663 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:20:39.624663 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eb02d23d-0c73-4214-8f00-713a6c5922fa could not be found. Oct 11 12:20:39.624663 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:20:39.624663 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:20:39.624663 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:20:39.624663 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:20:39.624663 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:20:39.624663 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:20:39.624663 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:20:39.624663 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:20:39.624663 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:20:39.626372 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:20:39.626372 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 12:20:39.626372 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 12:20:39.626372 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:20:39.626372 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:20:39.626372 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:20:39.626372 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:20:39.626372 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eb02d23d-0c73-4214-8f00-713a6c5922fa could not be found. Oct 11 12:20:39.626372 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:20:39.626372 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:20:39.626372 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:20:39.626372 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:20:39.626372 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:20:39.626372 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:20:39.626372 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:20:39.626372 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:20:39.626372 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eb02d23d-0c73-4214-8f00-713a6c5922fa could not be found. Oct 11 12:20:39.626372 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:20:39.628207 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-eef0dc16-5c79-4a79-b2c1-b7c94e4075c7 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Returning 404 to user: Instance eb02d23d-0c73-4214-8f00-713a6c5922fa could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:20:39.628207 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-eef0dc16-5c79-4a79-b2c1-b7c94e4075c7 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa" status: 404 len: 111 microversion: 2.1 time: 0.030351 Oct 11 12:20:39.628207 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 616/1184] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:20:39 2022] GET /compute/v2.1/servers/eb02d23d-0c73-4214-8f00-713a6c5922fa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:20:42.742541 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-f06d71fc-6ccb-49dd-877d-bb7b4a9c89d6 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:20:42.743122 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-f06d71fc-6ccb-49dd-877d-bb7b4a9c89d6 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 38015aaa-72c1-420e-95bd-596e493b6e87] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:20:42.744347 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-e23ed430-1bef-4877-a07d-ff6510489a3d req-ff75d176-c605-46e3-be49-58aa1cb93acb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38015aaa-72c1-420e-95bd-596e493b6e87", "tag": "98448cdf-7d5c-4dc2-9447-c9b25ebcaea1"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:20:42.749811 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f06d71fc-6ccb-49dd-877d-bb7b4a9c89d6 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:20:42.750305 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f06d71fc-6ccb-49dd-877d-bb7b4a9c89d6 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:20:42.750922 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f06d71fc-6ccb-49dd-877d-bb7b4a9c89d6 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:20:42.751623 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f06d71fc-6ccb-49dd-877d-bb7b4a9c89d6 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:20:42.752074 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f06d71fc-6ccb-49dd-877d-bb7b4a9c89d6 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:20:42.752499 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-f06d71fc-6ccb-49dd-877d-bb7b4a9c89d6 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:20:42.754355 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-e23ed430-1bef-4877-a07d-ff6510489a3d req-ff75d176-c605-46e3-be49-58aa1cb93acb service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:20:42.754845 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-e23ed430-1bef-4877-a07d-ff6510489a3d req-ff75d176-c605-46e3-be49-58aa1cb93acb service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:20:42.755268 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-e23ed430-1bef-4877-a07d-ff6510489a3d req-ff75d176-c605-46e3-be49-58aa1cb93acb service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:20:42.767436 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-e23ed430-1bef-4877-a07d-ff6510489a3d req-ff75d176-c605-46e3-be49-58aa1cb93acb service nova] Creating event network-changed:98448cdf-7d5c-4dc2-9447-c9b25ebcaea1 for instance 38015aaa-72c1-420e-95bd-596e493b6e87 on hv-cinder-82099 Oct 11 12:20:42.773074 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-e23ed430-1bef-4877-a07d-ff6510489a3d req-ff75d176-c605-46e3-be49-58aa1cb93acb service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032534 Oct 11 12:20:42.774082 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 617/1185] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:20:42.781115 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-f06d71fc-6ccb-49dd-877d-bb7b4a9c89d6 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 38015aaa-72c1-420e-95bd-596e493b6e87] Going to try to terminate instance {{(pid=118994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 12:20:42.870925 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-f06d71fc-6ccb-49dd-877d-bb7b4a9c89d6 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "DELETE /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87" status: 204 len: 0 microversion: 2.1 time: 0.132308 Oct 11 12:20:42.872311 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 569/1186] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Oct 11 12:20:42 2022] DELETE /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 12:20:42.881299 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-4031cb96-d37f-468c-a2a4-56fcb7aa2fb4 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:20:42.881977 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-4031cb96-d37f-468c-a2a4-56fcb7aa2fb4 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 38015aaa-72c1-420e-95bd-596e493b6e87] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:20:42.888230 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4031cb96-d37f-468c-a2a4-56fcb7aa2fb4 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:20:42.888733 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4031cb96-d37f-468c-a2a4-56fcb7aa2fb4 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:20:42.889166 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4031cb96-d37f-468c-a2a4-56fcb7aa2fb4 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:20:42.889850 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4031cb96-d37f-468c-a2a4-56fcb7aa2fb4 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:20:42.890303 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4031cb96-d37f-468c-a2a4-56fcb7aa2fb4 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:20:42.890745 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-4031cb96-d37f-468c-a2a4-56fcb7aa2fb4 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:20:43.023274 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.policy [None req-4031cb96-d37f-468c-a2a4-56fcb7aa2fb4 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118995) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:20:43.031379 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-4031cb96-d37f-468c-a2a4-56fcb7aa2fb4 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87" status: 200 len: 1576 microversion: 2.1 time: 0.154320 Oct 11 12:20:43.031941 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 618/1187] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:20:42 2022] GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87 => generated 1576 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:20:44.055545 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-3cafec64-4976-4a95-8134-d3a82bfcd903 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:20:44.056506 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-3cafec64-4976-4a95-8134-d3a82bfcd903 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 38015aaa-72c1-420e-95bd-596e493b6e87] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:20:44.063433 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3cafec64-4976-4a95-8134-d3a82bfcd903 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:20:44.064088 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3cafec64-4976-4a95-8134-d3a82bfcd903 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:20:44.064634 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3cafec64-4976-4a95-8134-d3a82bfcd903 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:20:44.065628 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3cafec64-4976-4a95-8134-d3a82bfcd903 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:20:44.066326 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3cafec64-4976-4a95-8134-d3a82bfcd903 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:20:44.066861 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-3cafec64-4976-4a95-8134-d3a82bfcd903 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:20:44.449999 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-3cafec64-4976-4a95-8134-d3a82bfcd903 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:20:44.458633 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-3cafec64-4976-4a95-8134-d3a82bfcd903 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87" status: 200 len: 1576 microversion: 2.1 time: 0.407374 Oct 11 12:20:44.459506 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 570/1188] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:20:44 2022] GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87 => generated 1576 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:20:45.307568 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [req-2ae20f95-832e-4a42-bf0f-123422af87de req-83b0dfa5-c9ba-47ee-81c6-ec1824f812c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38015aaa-72c1-420e-95bd-596e493b6e87", "name": "network-vif-deleted", "tag": "98448cdf-7d5c-4dc2-9447-c9b25ebcaea1"}]} {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 12:20:45.320138 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-2ae20f95-832e-4a42-bf0f-123422af87de req-83b0dfa5-c9ba-47ee-81c6-ec1824f812c5 service nova] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:20:45.320609 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-2ae20f95-832e-4a42-bf0f-123422af87de req-83b0dfa5-c9ba-47ee-81c6-ec1824f812c5 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:20:45.321037 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [req-2ae20f95-832e-4a42-bf0f-123422af87de req-83b0dfa5-c9ba-47ee-81c6-ec1824f812c5 service nova] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:20:45.334070 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.compute.server_external_events [req-2ae20f95-832e-4a42-bf0f-123422af87de req-83b0dfa5-c9ba-47ee-81c6-ec1824f812c5 service nova] Creating event network-vif-deleted:98448cdf-7d5c-4dc2-9447-c9b25ebcaea1 for instance 38015aaa-72c1-420e-95bd-596e493b6e87 on hv-cinder-82099 Oct 11 12:20:45.341740 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [req-2ae20f95-832e-4a42-bf0f-123422af87de req-83b0dfa5-c9ba-47ee-81c6-ec1824f812c5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037458 Oct 11 12:20:45.342345 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 619/1189] 10.222.0.59 () {64 vars in 1317 bytes} [Tue Oct 11 12:20:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 12:20:45.483395 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-d08c6a68-399f-4331-9ec6-051a8d6522a0 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:20:45.484034 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-d08c6a68-399f-4331-9ec6-051a8d6522a0 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 38015aaa-72c1-420e-95bd-596e493b6e87] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:20:45.490880 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d08c6a68-399f-4331-9ec6-051a8d6522a0 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:20:45.491352 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d08c6a68-399f-4331-9ec6-051a8d6522a0 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:20:45.491812 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d08c6a68-399f-4331-9ec6-051a8d6522a0 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:20:45.492487 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d08c6a68-399f-4331-9ec6-051a8d6522a0 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:20:45.492944 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d08c6a68-399f-4331-9ec6-051a8d6522a0 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:20:45.493338 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d08c6a68-399f-4331-9ec6-051a8d6522a0 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:20:45.554625 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.policy [None req-d08c6a68-399f-4331-9ec6-051a8d6522a0 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '82c54e3aa3aa46a28373acb91f32cc9a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f2eaa1959394ae3a4b4b27d00b917d1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 12:20:45.562797 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-d08c6a68-399f-4331-9ec6-051a8d6522a0 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87" status: 200 len: 1224 microversion: 2.1 time: 0.083306 Oct 11 12:20:45.563356 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 571/1190] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:20:45 2022] GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 12:20:46.590812 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8c00c17b-802b-462b-863e-3454cee847cb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:20:46.591896 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-8c00c17b-802b-462b-863e-3454cee847cb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 38015aaa-72c1-420e-95bd-596e493b6e87] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:20:46.600315 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8c00c17b-802b-462b-863e-3454cee847cb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:20:46.600791 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8c00c17b-802b-462b-863e-3454cee847cb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:20:46.601220 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8c00c17b-802b-462b-863e-3454cee847cb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:20:46.601913 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8c00c17b-802b-462b-863e-3454cee847cb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:20:46.602360 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8c00c17b-802b-462b-863e-3454cee847cb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:20:46.602805 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-8c00c17b-802b-462b-863e-3454cee847cb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:20:46.616247 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-8c00c17b-802b-462b-863e-3454cee847cb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] HTTP exception thrown: Instance 38015aaa-72c1-420e-95bd-596e493b6e87 could not be found. Oct 11 12:20:46.617867 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8c00c17b-802b-462b-863e-3454cee847cb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Request method failure captured: Oct 11 12:20:46.617867 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87 HTTP/1.1 Oct 11 12:20:46.617867 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 11 12:20:46.617867 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 11 12:20:46.617867 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Connection: close Oct 11 12:20:46.617867 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 11 12:20:46.617867 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 11 12:20:46.617867 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Host: 10.222.0.59 Oct 11 12:20:46.617867 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 11 12:20:46.617867 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 11 12:20:46.617867 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjRV3B3Ze2uMjiHad5GYeO-UuPwIbvGl7_ItGEygJinfPbqd63zqUFbzq4h6lT2072e_nEWiV9vy1oWj6HwkQ25mu5eDMXbJl4e6yTq2w79o-ctUFK8rr9ARidvk5gzBS09zXWOdfB8T4j29naGWXC0wC_gE7F01RblioUVP8TW3NFGm8 Oct 11 12:20:46.617867 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 11 12:20:46.617867 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 11 12:20:46.617867 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 11 12:20:46.617867 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 11 12:20:46.617867 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 11 12:20:46.617867 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 11 12:20:46.617867 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Id: 4f2eaa1959394ae3a4b4b27d00b917d1 Oct 11 12:20:46.617867 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-TestVolumeBootPattern-945275872 Oct 11 12:20:46.617867 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Role: reader,member Oct 11 12:20:46.617867 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Roles: reader,member Oct 11 12:20:46.619583 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4f2eaa1959394ae3a4b4b27d00b917d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4f2eaa1959394ae3a4b4b27d00b917d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f2eaa1959394ae3a4b4b27d00b917d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f2eaa1959394ae3a4b4b27d00b917d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:20:46.619583 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-TestVolumeBootPattern-945275872 Oct 11 12:20:46.619583 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 4f2eaa1959394ae3a4b4b27d00b917d1 Oct 11 12:20:46.619583 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-TestVolumeBootPattern-945275872 Oct 11 12:20:46.619583 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User: tempest-TestVolumeBootPattern-945275872-project Oct 11 12:20:46.619583 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 11 12:20:46.619583 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 11 12:20:46.619583 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Id: 82c54e3aa3aa46a28373acb91f32cc9a Oct 11 12:20:46.619583 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-TestVolumeBootPattern-945275872-project Oct 11 12:20:46.619583 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: method: > Oct 11 12:20:46.619583 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: exception: Instance 38015aaa-72c1-420e-95bd-596e493b6e87 could not be found. Oct 11 12:20:46.619583 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: action_args: {'id': '38015aaa-72c1-420e-95bd-596e493b6e87'} Oct 11 12:20:46.620609 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:20:46.620609 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:20:46.620609 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:20:46.620609 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:20:46.620609 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:20:46.620609 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:20:46.620609 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:20:46.620609 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:20:46.620609 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:20:46.620609 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:20:46.620609 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38015aaa-72c1-420e-95bd-596e493b6e87 could not be found. Oct 11 12:20:46.620609 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:20:46.620609 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:20:46.620609 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:20:46.620609 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:20:46.620609 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:20:46.620609 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:20:46.620609 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:20:46.620609 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:20:46.620609 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:20:46.622175 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:20:46.622175 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 12:20:46.622175 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 12:20:46.622175 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:20:46.622175 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:20:46.622175 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:20:46.622175 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:20:46.622175 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38015aaa-72c1-420e-95bd-596e493b6e87 could not be found. Oct 11 12:20:46.622175 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:20:46.622175 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:20:46.622175 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:20:46.622175 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:20:46.622175 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:20:46.622175 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:20:46.622175 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:20:46.622175 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:20:46.622175 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38015aaa-72c1-420e-95bd-596e493b6e87 could not be found. Oct 11 12:20:46.622175 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:20:46.623710 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-8c00c17b-802b-462b-863e-3454cee847cb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Returning 404 to user: Instance 38015aaa-72c1-420e-95bd-596e493b6e87 could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:20:46.623710 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-8c00c17b-802b-462b-863e-3454cee847cb tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87" status: 404 len: 111 microversion: 2.1 time: 0.035869 Oct 11 12:20:46.623710 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 620/1191] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:20:46 2022] GET /compute/v2.1/servers/38015aaa-72c1-420e-95bd-596e493b6e87 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:20:47.077041 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-d4e3e9fc-405d-4bc6-8baf-905fcecadee4 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:20:47.077654 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.compute.api [None req-d4e3e9fc-405d-4bc6-8baf-905fcecadee4 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 2f69fb21-4f8a-43d4-a5b9-fb52bab23576] Fetching instance by UUID {{(pid=118994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:20:47.084804 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d4e3e9fc-405d-4bc6-8baf-905fcecadee4 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:20:47.085280 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d4e3e9fc-405d-4bc6-8baf-905fcecadee4 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:20:47.085709 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d4e3e9fc-405d-4bc6-8baf-905fcecadee4 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:20:47.086395 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d4e3e9fc-405d-4bc6-8baf-905fcecadee4 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:20:47.086862 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d4e3e9fc-405d-4bc6-8baf-905fcecadee4 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:20:47.087281 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG oslo_concurrency.lockutils [None req-d4e3e9fc-405d-4bc6-8baf-905fcecadee4 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:20:47.101327 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.wsgi [None req-d4e3e9fc-405d-4bc6-8baf-905fcecadee4 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] HTTP exception thrown: Instance 2f69fb21-4f8a-43d4-a5b9-fb52bab23576 could not be found. Oct 11 12:20:47.103053 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-d4e3e9fc-405d-4bc6-8baf-905fcecadee4 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Request method failure captured: Oct 11 12:20:47.103053 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: request: DELETE /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576 HTTP/1.1 Oct 11 12:20:47.103053 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept: application/json Oct 11 12:20:47.103053 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Accept-Encoding: identity Oct 11 12:20:47.103053 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Connection: close Oct 11 12:20:47.103053 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Length: 0 Oct 11 12:20:47.103053 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Content-Type: application/json Oct 11 12:20:47.103053 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Host: 10.222.0.59 Oct 11 12:20:47.103053 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: Openstack-System-Scope: None Oct 11 12:20:47.103053 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: User-Agent: python-urllib3/1.26.12 Oct 11 12:20:47.103053 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Auth-Token: gAAAAABjRV3B3Ze2uMjiHad5GYeO-UuPwIbvGl7_ItGEygJinfPbqd63zqUFbzq4h6lT2072e_nEWiV9vy1oWj6HwkQ25mu5eDMXbJl4e6yTq2w79o-ctUFK8rr9ARidvk5gzBS09zXWOdfB8T4j29naGWXC0wC_gE7F01RblioUVP8TW3NFGm8 Oct 11 12:20:47.103053 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Id: None Oct 11 12:20:47.103053 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Domain-Name: None Oct 11 12:20:47.103053 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Identity-Status: Confirmed Oct 11 12:20:47.103053 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Is-Admin-Project: True Oct 11 12:20:47.103053 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Id: default Oct 11 12:20:47.103053 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Domain-Name: Default Oct 11 12:20:47.103053 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Id: 4f2eaa1959394ae3a4b4b27d00b917d1 Oct 11 12:20:47.103053 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Project-Name: tempest-TestVolumeBootPattern-945275872 Oct 11 12:20:47.103053 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Role: reader,member Oct 11 12:20:47.103053 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Roles: reader,member Oct 11 12:20:47.104685 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4f2eaa1959394ae3a4b4b27d00b917d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4f2eaa1959394ae3a4b4b27d00b917d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f2eaa1959394ae3a4b4b27d00b917d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f2eaa1959394ae3a4b4b27d00b917d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:20:47.104685 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant: tempest-TestVolumeBootPattern-945275872 Oct 11 12:20:47.104685 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Id: 4f2eaa1959394ae3a4b4b27d00b917d1 Oct 11 12:20:47.104685 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-Tenant-Name: tempest-TestVolumeBootPattern-945275872 Oct 11 12:20:47.104685 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User: tempest-TestVolumeBootPattern-945275872-project Oct 11 12:20:47.104685 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Id: default Oct 11 12:20:47.104685 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Domain-Name: Default Oct 11 12:20:47.104685 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Id: 82c54e3aa3aa46a28373acb91f32cc9a Oct 11 12:20:47.104685 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: X-User-Name: tempest-TestVolumeBootPattern-945275872-project Oct 11 12:20:47.104685 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: method: > Oct 11 12:20:47.104685 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: exception: Instance 2f69fb21-4f8a-43d4-a5b9-fb52bab23576 could not be found. Oct 11 12:20:47.104685 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: action_args: {'id': '2f69fb21-4f8a-43d4-a5b9-fb52bab23576'} Oct 11 12:20:47.105557 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:20:47.105557 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:20:47.105557 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:20:47.105557 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:20:47.105557 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:20:47.105557 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:20:47.105557 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:20:47.105557 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:20:47.105557 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:20:47.105557 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:20:47.105557 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f69fb21-4f8a-43d4-a5b9-fb52bab23576 could not be found. Oct 11 12:20:47.105557 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:20:47.105557 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:20:47.105557 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:20:47.105557 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:20:47.105557 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:20:47.105557 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:20:47.105557 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:20:47.105557 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:20:47.105557 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:20:47.107135 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:20:47.107135 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 12:20:47.107135 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 12:20:47.107135 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 12:20:47.107135 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 12:20:47.107135 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:20:47.107135 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:20:47.107135 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:20:47.107135 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:20:47.107135 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f69fb21-4f8a-43d4-a5b9-fb52bab23576 could not be found. Oct 11 12:20:47.107135 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:20:47.107135 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:20:47.107135 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:20:47.107135 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:20:47.107135 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:20:47.107135 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:20:47.107135 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:20:47.107135 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:20:47.107135 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f69fb21-4f8a-43d4-a5b9-fb52bab23576 could not be found. Oct 11 12:20:47.107135 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: ERROR nova.api.openstack.wsgi Oct 11 12:20:47.108587 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-d4e3e9fc-405d-4bc6-8baf-905fcecadee4 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Returning 404 to user: Instance 2f69fb21-4f8a-43d4-a5b9-fb52bab23576 could not be found. {{(pid=118994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:20:47.108587 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-d4e3e9fc-405d-4bc6-8baf-905fcecadee4 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576" status: 404 len: 111 microversion: 2.1 time: 0.031596 Oct 11 12:20:47.108587 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 572/1192] 10.222.0.59 () {58 vars in 1239 bytes} [Tue Oct 11 12:20:47 2022] DELETE /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:20:47.114323 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-84ae615f-ed91-470a-a737-55bb17d776ea tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '>' {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:20:47.115064 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.compute.api [None req-84ae615f-ed91-470a-a737-55bb17d776ea tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] [instance: 2f69fb21-4f8a-43d4-a5b9-fb52bab23576] Fetching instance by UUID {{(pid=118995) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 12:20:47.121937 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-84ae615f-ed91-470a-a737-55bb17d776ea tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:20:47.122479 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-84ae615f-ed91-470a-a737-55bb17d776ea tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:20:47.122955 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-84ae615f-ed91-470a-a737-55bb17d776ea tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:20:47.123652 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-84ae615f-ed91-470a-a737-55bb17d776ea tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Acquiring lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 12:20:47.124100 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-84ae615f-ed91-470a-a737-55bb17d776ea tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 12:20:47.124523 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG oslo_concurrency.lockutils [None req-84ae615f-ed91-470a-a737-55bb17d776ea tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Lock "e492fd93-7bd3-42bb-9bb9-d80ad3eb5733" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118995) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 12:20:47.138527 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.wsgi [None req-84ae615f-ed91-470a-a737-55bb17d776ea tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] HTTP exception thrown: Instance 2f69fb21-4f8a-43d4-a5b9-fb52bab23576 could not be found. Oct 11 12:20:47.140362 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-84ae615f-ed91-470a-a737-55bb17d776ea tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Request method failure captured: Oct 11 12:20:47.140362 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: request: GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576 HTTP/1.1 Oct 11 12:20:47.140362 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept: application/json Oct 11 12:20:47.140362 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Accept-Encoding: identity Oct 11 12:20:47.140362 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Connection: close Oct 11 12:20:47.140362 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Length: 0 Oct 11 12:20:47.140362 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Content-Type: application/json Oct 11 12:20:47.140362 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Host: 10.222.0.59 Oct 11 12:20:47.140362 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: Openstack-System-Scope: None Oct 11 12:20:47.140362 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: User-Agent: python-urllib3/1.26.12 Oct 11 12:20:47.140362 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Auth-Token: gAAAAABjRV3B3Ze2uMjiHad5GYeO-UuPwIbvGl7_ItGEygJinfPbqd63zqUFbzq4h6lT2072e_nEWiV9vy1oWj6HwkQ25mu5eDMXbJl4e6yTq2w79o-ctUFK8rr9ARidvk5gzBS09zXWOdfB8T4j29naGWXC0wC_gE7F01RblioUVP8TW3NFGm8 Oct 11 12:20:47.140362 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Id: None Oct 11 12:20:47.140362 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Domain-Name: None Oct 11 12:20:47.140362 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Identity-Status: Confirmed Oct 11 12:20:47.140362 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Is-Admin-Project: True Oct 11 12:20:47.140362 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Id: default Oct 11 12:20:47.140362 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Domain-Name: Default Oct 11 12:20:47.140362 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Id: 4f2eaa1959394ae3a4b4b27d00b917d1 Oct 11 12:20:47.140362 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Project-Name: tempest-TestVolumeBootPattern-945275872 Oct 11 12:20:47.140362 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Role: reader,member Oct 11 12:20:47.140362 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Roles: reader,member Oct 11 12:20:47.142241 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/4f2eaa1959394ae3a4b4b27d00b917d1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.59:8080", "publicURL": "http://10.222.0.59:8080/v1/AUTH_4f2eaa1959394ae3a4b4b27d00b917d1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f2eaa1959394ae3a4b4b27d00b917d1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/4f2eaa1959394ae3a4b4b27d00b917d1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}] Oct 11 12:20:47.142241 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant: tempest-TestVolumeBootPattern-945275872 Oct 11 12:20:47.142241 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Id: 4f2eaa1959394ae3a4b4b27d00b917d1 Oct 11 12:20:47.142241 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-Tenant-Name: tempest-TestVolumeBootPattern-945275872 Oct 11 12:20:47.142241 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User: tempest-TestVolumeBootPattern-945275872-project Oct 11 12:20:47.142241 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Id: default Oct 11 12:20:47.142241 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Domain-Name: Default Oct 11 12:20:47.142241 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Id: 82c54e3aa3aa46a28373acb91f32cc9a Oct 11 12:20:47.142241 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: X-User-Name: tempest-TestVolumeBootPattern-945275872-project Oct 11 12:20:47.142241 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: method: > Oct 11 12:20:47.142241 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: exception: Instance 2f69fb21-4f8a-43d4-a5b9-fb52bab23576 could not be found. Oct 11 12:20:47.142241 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: action_args: {'id': '2f69fb21-4f8a-43d4-a5b9-fb52bab23576'} Oct 11 12:20:47.143279 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: {{(pid=118995) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 12:20:47.143279 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:20:47.143279 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 12:20:47.143279 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 12:20:47.143279 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 12:20:47.143279 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 12:20:47.143279 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 12:20:47.143279 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 12:20:47.143279 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 12:20:47.143279 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 12:20:47.143279 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f69fb21-4f8a-43d4-a5b9-fb52bab23576 could not be found. Oct 11 12:20:47.143279 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:20:47.143279 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:20:47.143279 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:20:47.143279 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:20:47.143279 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:20:47.143279 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:20:47.143279 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 12:20:47.143279 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 12:20:47.143279 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 12:20:47.145230 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 12:20:47.145230 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 12:20:47.145230 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 12:20:47.145230 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 12:20:47.145230 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 12:20:47.145230 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 12:20:47.145230 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 12:20:47.145230 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f69fb21-4f8a-43d4-a5b9-fb52bab23576 could not be found. Oct 11 12:20:47.145230 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:20:47.145230 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 12:20:47.145230 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:20:47.145230 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 12:20:47.145230 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 12:20:47.145230 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 12:20:47.145230 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 12:20:47.145230 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 12:20:47.145230 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f69fb21-4f8a-43d4-a5b9-fb52bab23576 could not be found. Oct 11 12:20:47.145230 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: ERROR nova.api.openstack.wsgi Oct 11 12:20:47.146774 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: DEBUG nova.api.openstack.wsgi [None req-84ae615f-ed91-470a-a737-55bb17d776ea tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Returning 404 to user: Instance 2f69fb21-4f8a-43d4-a5b9-fb52bab23576 could not be found. {{(pid=118995) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 12:20:47.146774 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: INFO nova.api.openstack.requestlog [None req-84ae615f-ed91-470a-a737-55bb17d776ea tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576" status: 404 len: 111 microversion: 2.1 time: 0.032304 Oct 11 12:20:47.146774 dv-cinder-820994-6-iscsi devstack@n-api.service[118995]: [pid: 118995|app: 0|req: 621/1193] 10.222.0.59 () {58 vars in 1236 bytes} [Tue Oct 11 12:20:47 2022] GET /compute/v2.1/servers/2f69fb21-4f8a-43d4-a5b9-fb52bab23576 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 12:20:48.462253 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: DEBUG nova.api.openstack.wsgi [None req-0176078e-30bd-4c51-91d0-ffc6eb3c6d98 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] Calling method '.version_select at 0x7fd406794af0>' {{(pid=118994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 12:20:48.489850 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: INFO nova.api.openstack.requestlog [None req-0176078e-30bd-4c51-91d0-ffc6eb3c6d98 tempest-TestVolumeBootPattern-945275872 tempest-TestVolumeBootPattern-945275872-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-79745519" status: 202 len: 0 microversion: 2.1 time: 0.031312 Oct 11 12:20:48.490296 dv-cinder-820994-6-iscsi devstack@n-api.service[118994]: [pid: 118994|app: 0|req: 573/1194] 10.222.0.59 () {58 vars in 1257 bytes} [Tue Oct 11 12:20:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-79745519 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)